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Abstract 

General theorems for existence and uniqueness of viscosity solutions for Hamilton- 
Jacobi-Bellman quasi-variational inequalities (HJBQVI) with integral term are es- 
tablished. Such nonlinear partial integro-differential equations (PIDE) arise in the 
study of combined impulse and stochastic control for jump-diffusion processes. The 
HJBQVI consists of an HJB part (for stochastic control) combined with a nonlocal 
impulse intervention term. 

Existence results are proved via stochastic means, whereas our uniqueness (com- 
parison) results adapt techniques from viscosity solution theory. This paper is to our 
knowledge the first treating rigorously impulse control for jump-diffusion processes 
in a general viscosity solution framework; the jump part may have infinite activity. 
In the proofs, no prior continuity of the value function is assumed, quadratic costs 
are allowed, and elliptic and parabolic results are presented for solutions possibly 
unbounded at infinity. 
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1 Introduction 



Impulse control is concerned with controlling optimally a stochastic process by giving it 
impulses at discrete intervention times. We consider a process X evolving according to 
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the controlled stochastic differential equation (SDE) 



dXt = fxit,Xt_,/3t-)dt + ait,Xt_,f3t-)dWt + j £{1, X^., (3t-, z) N{dz,dt), (1) 

for a standard Brownian motion W and a compensated Poisson random measure N{dz, dt) = 
N{dz, dt) — l\z\<ii^{dz)dt) with (possibly unbounded) intensity measure u (the jumps of a 
Levy process), and the stochastic control process /3 (with values in some compact set B). 
The impulses occur at stopping times (rj)i>i, and have the effect 

Xr^ = T(t, Xr^-, Ci), 

after which the process continues to evolve according to the controlled SDE until the 
next impulse. (Detailed notation and definitions are introduced in Section [2j) We denote 
by 7 = (rj,^j)j>i the impulse control strategy, and by a = (/3,7) a combined control 
consisting of a stochastic control /3 and an impulse control 7. The aim is to maximise a 
certain functional, dependent on the impulse-controlled process X° until the exit time r 
(e.g., for a finite time horizon T > 0, t := ts AT, where ts is the exit time of X" from a 
possibly unbounded set S): 



v{t,x) := maxE^*'^'^ 



r f{s, X:, (3s)ds + g{T, X-)l,<oo + Yl ^^(^v Q) 



(MAX) 



Here the negative function K incorporates the impulse transaction costs, and the func- 
tions / and g are profit functions. 



Applications. Typically, impulse control problems involve fixed (and variable) trans- 
action costs, as opposed to singular control (only proportional transaction costs), and 
stochastic control (where there are no interventions). This is why an impulse control for- 
mulation is a natural framework for modelling incomplete markets in finance (the market 
frictions being the transaction costs). The standard reference for applications as well as 



as a more recent overview for jump- 



for theory is certainly Bensoussan and Lions 
diffusions, 0ksendal and Sulem jsl] can be helpful. 

Although our results are quite general, we will mainly have financial applications in mind. 



Among those, we mention only the following (for some complements, see 32 



Option pricing with transaction costs [471], [20], [14 



costs 38 



Tracking an optimal portfolio ([42], 40|), or portfolio optimisation with transaction 



Guaranteed Minimum Withdrawal Benefits (GMWB) in long-term insurance con- 



tracts 



16 



Control of an exchange rate by the Central Bank [37[ , [15 
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The last application is a good example for combined control: there are two different means 
of intervention, namely interest rates (stochastic control) and FX market interventions. 
The stochastic control affects the process continuously (we neglect transaction costs here), 
and the impulses have fixed transaction costs, but have an immediate effect and thus can 
better react to jumps in the stochastic process. 

Quasi-variational inequality. The standard approach for solution of (]MAX|) is 
certainly to analyse the so-called Hamilton-Jacobi-Bellman quasi-variational inequality 
(HJBQVI) on the value function here in its parabolic form: 

mm{-sup{ut + L^u + f^},u- Mu) = in [0,T) x S (QVI) 
for L'^ the infinitesimal generator of the SDE ([1]) (where y = (t, x)). 



+ j u{t,x + l{y,l3,z))-u{y)- iy^u{y),i{y,l3,z))l\,\^iu{dz), 
and M. the intervention operator selecting the momentarily best impulse. 



Mu{t, x) = sup{u(t, T{t, X, C)) + K{t, X, ()}. 
C 



In this paper, we will prove existence and uniqueness of viscosity solutions of (QVI) (for a 



general introduction to viscosity solutions, we recommend the "User's Guide" by Crandall 



et al. 18|). Our goal is to establish a framework that can be readily used (and extended) 



in applications, without too many technical conditions. For other solution approaches to 



(QVI) and impulse control problems, we refer to Bensoussan and Lions Davis [2l| 



and 0ksendal and Sulem 39 . 



( QVI ) is formally a nonlinear, nonlocal, possibly degenerate, second order parabolic par- 
tial integro-differential equation (PIDE). We point out that the investigated stochastic 
process is allowed to have jumps (jump-diffusion process), including so-called "infinite- 
activity processes" where the jump measure u may be singular at the origin. (It can be 
argued that infinite-activity processes are a good model for stock prices, see, e.g., Cont 



and Tankov 17|, Eberlein and Keller 24 1. 



Contribution. Literature. Our main contribution is to rigorously treat general 
existence and uniqueness of viscosity solutions of impulse control QVI for the jump- 



diffusion process ([T]). (An existence result can also be found in Oksendal and Sulem [39 
but in the proof many technical details are omitted; the uniqueness part has not yet been 
covered to our best knowledge.) Apart from this main contribution, we investigate the 
QVI on the whole space with appropriate boundary conditions (the boundary is in 
general not a null set of M"^), and with only minimal assumptions on continuity of the value 
function (the continuity will then be a consequence of the viscosity solution uniqueness). 
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Our solutions can be unbounded at infinity with arbitrary polynomial growth, provided 
appropriate conditions on the functions involved are satisfied, and superlinear transaction 
costs (e.g., quadratic) are allowed. 

Let us now give a short overview on existing literature for QVI in the viscosity solution 
context. The book by 0ksendal and Sulem 39|] is a recent overview on general stochastic 
control for jump processes, including QVI and viscosity solutions. The authors present 
rather general existence and uniqueness results for viscosity solutions of QVI. However, 
they assume that the value function is continuous (which is wrong in general), and they 
do not treat boundary values. Furthermore, their uniqueness proof (only in the diffusion 
case) assumes conditions that are not satisfied in a typical one-dimensional case. So the 
present paper can also serve as complement to their sketch of proof. Other papers by 
the authors (mostly concerned with specific portfolio optimisation problems) are 38|, 
along with other references given in their book. 

A complete and rigorous proof of existence and uniqueness in the viscosity solutions 



framework was given by K. Ishii (29|, but only without jumps in the underlying stochastic 



process, and without stochastic control. Our approach to uniqueness is inspired by this 



paper. Tang and Yong 48|] present an early proof for a finite time horizon (no exit 



time) including stochastic control and optimal switching, but again only for a continuous 
stochastic process and under rather restrictive assumptions. They use the continuity of the 
value function, the proof of which covers 11 pages. A more recent paper on impulse control 
(in a portfolio optimisation context) is Ly Vath et al. 35|. They too treat only a diffusion 
problem (without integral terms), but prove existence and uniqueness of discontinuous 
viscosity solutions. We extend their approach to existence to a general jump- diffusion 
context in the present paper. 

As further references (without being exhaustive), we mentirai Fleming and Soner [lil 



for viscosity solutions in general stochastic control, Pham |41| for optimal stopping of 
controlled jump-diffusion processes, and Lenhart [33| for impulse control of piecewise 
deterministic processes. A very good account of discontinuous viscosity solutions and 
strong uniqueness for HJB equations is given in Barles and Rouy jof. 

Because the Levy measure is allowed to have a singularity of second order at 0, we cannot 



use the standard approach to uniqueness of viscosity solutions of PDE as used in 4l| for 
optimal stopping, and in 12 1 for singular control. For a more detailed discussion, we refer 
to Jakobsen and Karlsen 30|] (and the references therein), who were the first to propose a 
way to circumvent the problem for an HJB PIDE; see also the remark in the uniqueness 
section. 

For our proof of uniqueness, we will use and extend the framework as presented in the 



more recent paper Barles and Imbert [8[ (the formulation in [30[ does not permit an easy 



impulse control extension). The reader might also find helpful Barles et al. 10 



Contents. The paper consists of 4 main sections. Section 2 presents the detailed 
problem formulation, the assumptions and a summary of the main result; some helpful 
properties of the investigated problem are derived in Section 3. The following Section 4 
is concerned with existence of a QVI viscosity solution. After introducing the setting of 
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our impulse control problem and several helpful results, we prove in Theorem 14.21 that 
the value function is a (discontinuous) QVI viscosity solution. The existence result for 
the elliptic QVI is deduced from the corresponding parabolic one. The last main section 
(Section 5) then starts with a reformulation of the QVI and several equivalent definitions 
for viscosity solutions. A maximum principle for impulse control is then derived, and 
used in a comparison result, which yields uniqueness and continuity of the QVI viscosity 
solution. The unboundedness of the domain is treated by a perturbation technique using 
strict viscosity sub- and supersolutions. The paper is complemented by a synthesis and 
summary at the end. 

Notation. M'^ for > 1 is the Euclidean space equipped with the usual norm and the 
scalar product denoted by (■,■). For sets A,B(Z M.'^, the notation A CC B (compactly 
embedded) means that A G B, and = M"^ \ A is the complement of A. We denote 
the space of symmetric matrices C M.'^^'^ by S*^, > is the usual ordering in M'^^'^, i.e. 
X > Y X — Y positive semidefinite. | ■ | on S"' is the usual eigenvalue norm. C^(R"') is 
the space of all functions two times continuously differentiable with values in M, and as 
usual, Ut denotes the time derivative of u. L^(P;R'^) is the Hilbert space of all P-square- 
integrable measurable random variables with values in M"^, the measure = P o X~^ is 
sometimes used to lighten notation. 



2 Model and main result 

Let a filtered probability space {Q, T , {J^t)t>o, P) satisfying the usual assumptions be given. 
Consider an adapted m-dimensional Brownian motion W, and an adapted independent 
fc-dimensional pure-jump Levy process represented by the compensated Poisson random 
measure N{dz,dt) = N{dz,dt) — l\z\<ii^{dz)dt), where as always /(|-sp A 1) uldz) < oo 
for the Levy measure u. We assume as usual that all processes are right-continuous. 
Assume the (i- dimensional state process X follows the stochastic differential equation 
with impulses 

dXt = fi{t,Xt_,(3t-)dt + a{t,Xt^,Pt_)dWt+ / i{t,Xt-,l3t-,z)N{dz,dt), r, < t < r^+i 

x^^_^, = r{t,Xr,^,.,Q+i) ^eNo 

(2) 

for r : X M^rf ^ measurable, and : R-^ xR'^ x B ^ W^, a : R-^ xR'^ x B ^ M"^^"^ 
satisfying the necessary conditions such that existence and uniqueness of the SDE is 
guaranteed. /3 is a cadlag adapted stochastic control (where P{t,u) & B, B compact 
non-empty metric space), and 7 = (ri, r2, . . . , Ci, C25 • • •) is the impulse control strategy, 
where Tj are stopping times with = tq < ti < T2 < ■ ■ and Q are adapted impulses. 
The measurable transaction set Z{t,x) C R'^ denotes the allowed impulses when at time 
t in state x. We denote by a = (/3, 7) the so-called combined stochastic control, where 
a & A = A{t,x), the admissible region for the combined stochastic control. Admissible 
means here in particular that existence and uniqueness of the SDE be guaranteed, and 
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that we only consider Markov controls (detailed in section |3]). We further assume that all 
constant stochastic controls /3 G -B are admissible. 

The term denotes the value of the controlled X° in Tj with a possible jump of the 
stochastic process, but without the impulse, i.e., = + where A denotes 

the jump of the stochastic process. So for the first impulse, this would be the process 
= only controlled by the continuous control. If two or more impulses happen to 
be at the same time (e.g., Tj+i = Tj), then ([2]) is to be understood as concatenation, e.g., 
r(^, r(t, Xr,-, 6), Ci4-i)- (The notation used here is borrowed from 0ksendal and Sulem 

The following conditions are sufficient for existence and uniqueness of the SDE for constant 
stochastic control /3 (cf. Gikhman and Skorokhod 27|, p. 273): There is an x G M.'^ and 



C > with / \£{t,x,l3,z)\'^u{dz) < C < oo for alH G [0,r], (3 e B. Furthermore, there 
exist C > and a positive function b with b{h) l for h s.th. 



\liit, X, P) - flit, y, /3) |2 + \a{t, X, (3)) - a{t, y, 

+ j \l{t,x,P,z)-l{t,y,f3,z)\''u{dz)<C\x-y\'' 
\lJ,{t + h,x,/3) - /i(t,x,/3)p + \a{t + h,x,(3)) -cr(t,x,/3)p 

+ / \i{t + h,x,/3,z)-i{t,x,(3,z)\^i^{dz) <C{l + \x\^)b{h) 



(3) 



These are essentially Lipschitz conditions, as one can easily check; see also Pham [41 
A solution of ([2]) with non-random starting value will then have finite second moments, 
which is preserved after an impulse if for X G L^{¥; R"^), also T{t, X, ({t, X)) G ^^(P; R'^). 
This is certainly the case if the impulses (j are in a compact and F continuous, which we 
will later assume. 

We only assume that existence and uniqueness hold with constant stochastic control (by 



or weaker conditions as in 27|), which guarantees that A{t,x) is non-empty. 



Remark 2.1 For existence and uniqueness of the SDE with arbitrary control process /S, it 
is not sufficient to simply assume Lipschitz conditions on x ^ fi{t, x, 0) etc. ( even if the 
Lipschitz constants are independent of the control /3 ), as done in Pham JX|/- If the control 
depends in a non-Lipschitzian or even discontinuous way on the current state, uniqueness 
or even existence of ^ might not hold. Compare also Gikhman and Skorokhod l2aj . p. 
156. 



Remark 2.2 The version of the SDE in ^ is the most general form of all Levy SDE 
formulations currently used. If the support of v is contained in the coordinate axes, then 
the one- dimensional components of the Levy process are independent, and the integral 
J^k^{t,Xt-, f3t-,z) N{dz,dt) can be splitted into several one- dimensional integrals (i.e. 
we obtain the form used in 0ksendal and Sulem fs^J). If furthermore i is linear in z, then 
we obtain the form as used in Protter fj^j, Th. V.32. 



The general (combined) impulse control problem is: find a = (/3, 7) G A that maximizes 
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the payoff starting in t with x 



where / : x M'^ x 5 ^ M, ^ : R([ x R'^ ^ M, : R+ x M^^ ^ M are measurable, 
and T = Ts = inf{s > t : ^ S} is the exit time from some open set 5* C R"^ (possibly 
infinite horizon), ot t = ts AT for some T > (finite horizon). Note that Xf is the value 
at s after all impulses in s have been applied; so "intermediate values" are not taken into 
account by this stopping time. 
The value function v is defined by 

v{t,x)= sup /°)(t,x) (5) 

aeA(t,x) 



f{s,X^,l3s)ds + g{T,X:^)l, 



<oo 



(4) 



We require the integrability condition on the negative parts of /, g, K 



< oo (6) 



for all a E A{t, x) 



Parabolic HJBQVI. Let the impulse intervention operator Ai = Ai^^'^^ be defined by 

Mu{t, x) = sup{n(t, r(t, X, C)) + K{t, x, C) : C e Z{t, x)} (7) 

(define Aiu{t,x) = — oo if Z{t,x) = - we will exclude this case later on). Then the 
hope is to find the value function by investigating the following parabolic Hamilton- Jacobi- 
Bellman QVl (T > finite): 

min(- snp{ut + L^u + /^}, u - Mu) = in [0, T) x S 

min(n - ^, n - A^n) = in [0, T) x (M'^ \ 5) (S) 
u = m&x{g,Mg,M'^g,...) on {T} x R"', 

for the generator of X in the SDE ([2]) for constant stochastic control /3, and f^{-) '■ = 
f{-,(5). The generator has the form [y = (t,x)): 

L^i{y) = ^tr {a{y, /3)a^(y, (3)Dlu{y)) + {^^{y, (3), VMv)) 

+ j u{t, X + i{y, /3, z)) - u{y) - (V^u(y), £(y, /3, 2;))li.i<i v{dz), (9) 

While the equation for S* in ([8]) can be motivated by Dynkin's formula and the fact that 
V > Aiv by the optimality of f , we have to argue why we consider the value function v on 
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[0,T) X M*^ instead of the interesting set [0,T) x S: This is due to the jump term of the 
underlying stochastic process. While it is not possible to stay a positive time outside S 
(we stop in ts), it is well possible in our setting that the stochastic process jumps outside, 
but we return to S by an impulse before the stopping time ts takes notice. Thus we 
must define v outside S, to be able to decide whether a jump back to S is worthwile. 
The boundary condition has its origin in the following necessary condition for the value 
function: 

min(t' — g,v — Mv)=0 m[0,T) X (R'^XS) (10) 

This formalises that the controller can either do nothing (i.e., at the end of the day, the 
stopping time ts has passed, and the game is over), or can jump back into S, and the 
game continues. A similar condition holds at time T < oo, with the difference that the 
controller is not allowed to jump back in time (as the device permitting this is not yet 
available to the public). So the necessary terminal condition can be put explicitly as 

V = sup{g,Mg,M^g,...) on {T} x M'^Q (11) 

Example 2.1 The impulse back from M.'^\S to S could correspond to a capital injection 
into profitable business to avoid untimely default due to a sudden event. 

Well-definedness of QVI terms. We need to establish conditions under which the 
terms L^u and A4u in the QVI (jH]) are well-defined. For Aiu compare the discussion of 
assumptions below. 

The integral operator in ([9]) is at the same time a differential operator of up to second 
order (if u singular). This can be seen by Taylor expansion for u G C^'^([0,T) x M*^) for 
some < 6 < 1: 

/ \u{t, X + i{x, /3, z)) — u{t, x) — (Vu{t, x),£{x, /3, 2;))l|2|<i| ^{dz) 

J\z\<5 

< [ \i{t,x,/3,z)\'^\D\{t,S:)\u{dz) (12) 

J\z\<5 

for an X G B{x, sup|^|<5 £{t, x, /3, z)). 

We take the Levy measure u as given. As for all Levy measures, / (|2;p A 1) u^dz) < oo. 
Let > be a number such that J^^^^-^_ {zl^* v{dz) < oo, and let g* > be a number such 
that Jj^i^^ \z\'^ v{dz) < oo (think of p* as the largest and q* the smallest such number, 

even if it does not exist). Then the expression sup^g^jn^ + L^n + /^} is well-defined, if, 
e.g., the following conditions are satisfied (depending on the singularity of z/ in and its 
behaviour at infinity): 

1. n G C"'^'^([0, T) xM'^), sup^g^ cr(t, x, j3) < oo, sup^g^ /x(t, x, (3) < oo, and sup^g^ /(t, x, (3) < 
oo for all (t, x) G [0, T) x S 

^If g is lower semicontinuous, if preserves this property and if the sup is finite, then it is well-known 
that ^(T, •) is lower semicontinuous. Even if g is continuous, v{T^ ■) need not be continuous 
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2. One of the following (all constants are independent of B, z, and the inequalities hold 



locally in {t,x) G [0,T) x S" if Ct^x is used as constaniq): 

(a) |£(t,x,/3,z)|<a,x. ifKK')<oo 

(b) \i{t,x,f3,z)\ < Ct,xi\z\) and \u{t, z)\ < C{1 + \zf) (C independent oft) 

(c) Or more generally, for a,b > such that ab < p*: \i(t, x, (3,z)\ < Ct,x(l + l-^l"), 
\u{t,z)\ < C{1 + on l^l > 1. Furthermore, \£{t, x, (3, z)\ < Ct^^W* on 



In the following, we will assume one of the above conditions on i (which is given), and 
define as in Barles and Imbert [sj for a fixed polynomial function i? : M'^ — )■ R satisfying 
condition 2.: 

Definition 2.1 (Space of polynomially bounded functions) VB = VB{[0,T)x'R'^) 
is the space of all measurable functions m : [0, T) x M'^ — )• M such that 



for a time-independent constant C„ > 0. 

As pointed out in jsj , this function space VB is stable under lower and upper semicontin- 
uous envelopes, and functions in VB are locally bounded. Furthermore, it is stable under 
(pointwise) limit operations, and the conditions for Lebesgue's Dominated Convergence 
Theorem are in general satisfied. 

Assumptions and main result. Let us now formalise the conditions necessary for 
both the existence and the uniqueness proof in the following assumption (see also the 
discussion at the end of the section): 

Assumption 2.1 (VI) F and K are continuous 

(V2) The transaction set Z{t,x) is non-empty and compact for each {t,x) G [0, T] x W^. 
For a converging sequence (t„, Xn) (t, x) in [0, T] x M'' (with Z{tn, x„) non-empty), 
Z{tn,Xn) converges to Z(t,x) in the Hausdorff metric 

(V3) jj.,a,i,f are continuous in {t,x,l3) on [0,T) xM.^ x B 

(V4) i satisfies one of the conditions detailed above, and VB is fixed accordingly 

Define 5t := [0, T) x 5 and its parabolic nonlocal "boundary" d+Sr := ([0,T) x (M^\5))u 
({T} X M^). Further denote d*ST := ([0,T) x OS) U ({T} x S). 

Apart from Assumption 12. ![ we will need the following assumptions for the proof of 
existence: 

^I.c, for all {t,x) G [0,T) x S, there exists a constant Ct.x > and a neighbourhood of {t,x) in 
[0, T)x S such that \£{t, x, /3, z)| < Ct,x for ah /3, z 




z\ < 1 



u{t,x)\ < Cu{l + R{x)) 
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Assumption 2.2 (El) The value function v is in VB{[0,T] x R'^) 
(E2) g is continuous 

(E3) The value function v satisfies for every {t,x) G d*ST, and all sequences {tn,Xn)n C 
[0,T) X S converging to {t,x): 

lim inf v(tn, Xn) > g{t, x) 

n— >oo 

Ifv{tn,Xn) > Mv{tn,Xn) Vw : lim sup i;(t„, x„) < g{t,x) 

n—^oo 

(E4) For all p> 0, (t,x) G [0,T) x 5", and sequences [0,T) x S 3 (tn,Xn) {t,x), there 
is a constant /3 (not necessarily in B) and an N such that for all < s < 1/N 
and n > N, 

P( sup |Xf'*"'^" - a;„| < p) < P( sup |xf - x„| < p), 

tn<s<t„+e t„<s<t„+e 

where X'^"'*"'^" is the process according to SDE started in (tn, Xn) and controlled 
by 

Tlie following assumptions are needed for the uniqueness proof (5 > 0): 

Assumption 2.3 (Ul) If u{R'') = oo: For all {t,x) G [0,T) x S, Us{t,x) := {i{x,P,z) : 
\z\ < 6} does not depend on /3 

(U2) // z/(]R^') = oo; For all {t,x) G [0,T) x S, dist{x,dUs{t,x)) is strictly positive for 
all5>0 (or£ = 0) 

Assumption 2.4 (Bl) J^^\i{t,x, z)-i{t,y, (3, z)\^u{dz) < C\x-y\'^ , J^^^^^\i{t,x, /3, z)- 
£{t,y, P, z)\i'{dz) < C\x — y\, and all estimates hold locally in t a [0,T), x,y, uni- 
formly in (i 

(B2) Let a{-, (3) , (3) , f{-,f3) be locally Lipschitz continuous, i.e. for each point {to, xq) G 
[0, T)xS there is a neigbourhood U 3 (to, Xq) (U open in [0, T) x W'-), and a constant 
C (independent of (3) such that |cr(t, x, (3) — a{t, y, /3)\ < C\x — y\ W(t, x), (t, y) G U , 
and likewise for fj, and f 

The space VBp = VBp{[0,T] x R'^) consists of all functions u G VB, for which there is a 
constant C such that \u{t,x)\ < C{1 + \x\p) for all G [0,T] x R"'. 

Under the above assumptions, we can now formulate our main result in the parabolic case 
(the precise definition of viscosity solution is introduced in Section Hj): 

Theorem 2.2 (Existence and uniqueness of a viscosity solution in the parabolic case) 

Let AssumptionslMJllM^ [E3 be satisfied. Assume further that v G VBp{[0, T] x M"'), 
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and that there is a nonnegative w G VB fl C^([0,T] x R'') with \w(t,x)\/\x\^ — > oo for 
|x| — oo (uniformly in t) and a constant k > such that 

min(— sup{u7t + L^w + f'^}, w — A4w) > k in St 

l3eB 

mm{w — g,w — J^w) > n in d'^ St- 

Then the value function v is the unique viscosity solution of the parabolic QVI and 
it is continuous on [0,T] x M*^. 



For the proof of Theorem \2.2\ see Theorems 14.21 and 15.141 



Elliptic HJBQVI. For finite time horizon T, ([8]) is investigated on [0, T] x (parabolic 
problem). For infinite horizon, typically a discounting factor e"^'-*"'"'^^ for p > applied 
to all functions takes care of the well-definedness of the value function, e.g., f{t,x,P) = 
e-pii+^) f(^x, (3). In this time-independent case, a transformation u{t,x) = e~^^^~^^^w{x) 
gives us the elliptic HJBQVI to investigate 



min(-sup{L^M + - A^m) = in 

I3£B 

mm{u - g,u- Mu) = in M'^ \ S* 
where the functions and variables have been appropriately renamed, and 

h'^u{x) = ^tr {cr{x,/3)a'^{x,/3)D'^u{x)) + Vm(x)) - pu{x) 
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+ J u{x + i{x, /3, z)) - u{x) - {Vu{x)J{x, /3, z))l\,\<i v{dz), (14) 
Mu{x) = sup{M(r(a;, 0) + K{x, C) : C e Z{x)]. (15) 



Under the time-independent version of the assumptions above, an essentially identical 
existence and uniqueness result holds for the elliptic QVI (|T3|) . We refrain from repeating 
it, and instead refer to Sections 14.21 and 15.41 for a precise formulation. 



Discussion of the assumptions. Of all assumptions, it is quite clear why we need the 
continuity assumptions, and they are easy to check. 

By (MS]), (Ml]) and the compactness of the control set B, the Hamiltonian sup^g^ Utit, x) + 
h^u{t,x) + f^{t,x) is well-defined and continuous in (t, x) G [0,T) x S* for n G VB fl 
C^'^([0,T) X M"'). (This follows by sup manipulations, the (locally) uniform continuity 
and the DCT for the integral part.) Instead of (MS]), assuming the continuity of the 
Hamiltonian is sufficient for the existence proof. For the stochastic process Xj, condition 
(Ml]) essentially ensures the existence of moments. 

By (MB, (M2]), we obtain that Aiu is locally bounded if u locally bounded in [0,T] x 
(e.g., if n G Pi3([0,T] x W^)). M.u is even continuous if u is continuous (so impulses 
preserve continuity properties), see Lemma [4.31 
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In condition (Vl2]), Z(t,x) 7^ is necessary for the Hausdorff metric of sets to be well- 
defined, and to obtain general results on continuity of the value function (it is easy to 
construct examples of discontinuous value functions otherwise). The assumption is how- 
ever no severe restriction, because we can set Z{t,x) = in the no-intervention region 
{v > A4.v} without affecting the value function. The compactness of Z{t,x) is not es- 
sential and can be relaxed in special cases — this restriction is however of no practical 
importance. 

Condition (E]3]) connects the combined control problem with the continuity of the stochas- 
tic control problem at the boundary. In this respect. Theorem 12.21 roughly states that the 
value function is continuous except if there is a discontinuity on the boundary dS. (E]3]) 
is typically satisfied if the stochastic process is regular at dS, as shown at the end of the 



section l¥?T| see also Fleming and Soner 26|, Theorem V.2.1, and the analytic approach 



in Barles et al. [10| . In particular, this condition excludes problems with true or de facto 
state constraints, although the framework can be extended to cover state constraints. 

(EH]) can be expected to hold because the control set B is compact and the functions 
/i, a, i are continuous in (t, x, (3) (VE]). The condition is very easy to check for a concrete 
problem — it would be a lot more cumbersome to state a general result, especially for 
the jump part. 



Example 2.2 If dXt = /3tdt + dWt, and /3t E B = [—1, 1], then P := 2 is a possible choice 
for to hold. 

Assumption 12.31 collects some minor prerequisites that only need to be satisfied for small 
S > (see also the remark in the beginning of section l5TT]) . and the formulation can easily 
be adapted to a specific problem. 

The local Lipschitz continuity in (B[T]) and (B|2]) is a standard condition; (B[T]) is satisfied 
if, e.g., the jump size of the stochastic process does not depend on x, or the conditions 
OH]) for existence and uniqueness of the SDE are satisfied for a constant f3. Condition (B[T]) 
can be relaxed if, e.g., X has a state-dependent (finite) jump intensity - the uniqueness 
proof adapts readily to this case. 

Certainly the most intriguing point is how to find a suitable function w meeting all the 
requirements detailed in Theorem 1221 (This requirement essentially means that we have a 
strict supersolution.) We first consider the elliptic case of QVI (fT3|l . Here such a function 
w for a K > can normally be constructed by w{x) = Wi\x\'^ + W2 for suitable Wi and 
q > p (but still w G VB\). Main prerequisites are then 

(LI) Positive interest rates: p > k for a suitably chosen constant k > 
(L2) Fixed transaction costs: e.g., K{xX) < —ko < 

If additionally we allow only impulses towards 0, then w — M.w > k is easily achieved, 
as well as w — (7 > K (if we require that g have a lower polynomial order than w). For a 
given bounded set, choosing W2 large enough makes sure that — sup^g^jL^ty + /^} > k 
on this set (due to the continuity of the Hamiltonian and translation invariance in the 
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integral). For \x\ — )■ oo, we need to impose conditions on k — these depend heavily on 
the problem at hand, but can require the discounting factor to be rather large (e.g., for a 
geometric Brownian motion). 

In the parabolic case, the same discussion holds accordingly, except that it is significantly 
easier to find a w G VB{[0,T] x M.'^) satisfying assumption (lH]): By setting w(t,x) = 
exp{—kt){wi\x\'^ + W2), we have Wt = —kw for arbitrarily large k. 

3 Probabilistic properties 

In this section, we establish the Markov property of the impulse-controlled process, and 
derive a version of the dynamic programming principle (DPP) which we will need for the 
existence proof. 

Markov property. For the Dynkin formula and several transformations, we need 
to establish the Markov property of the controlled process X". To be more precise, we 
need to prove the strong Markov property of Y^" := (s + for some s > 0. First, 

by Gikhman and Skorokhod Theorem 1 in Part II. 9, the Markov property for the 
uncontrolled process X holds (for a similar result, see Protter [43[, Th. V.32). If we 
consider the process Yt := (s + 1, X^+f), then the strong Markov property holds for Y. 

We only consider Markov controls in the following, i.e. I3(t,uj) = /3(y"(t— )), the impulse 
times Ti are exit times of Yf' (which makes sure they do not use past information), and Q 
are (T(y'^"_)-measurable. (That Markov controls are sufficient is clear intuitively, because 
it is of no use to consider the past, if my objective function only depends on future actions 
and events, and my underlying process already has the Markov property.) 

Proposition 3.1 Under the foregoing assumptions, the controlled process is a strong 
Markov process. 

Proof: For a stopping time T < 00 a.s., we have to show for all bounded measurable 
functions h and for all m > that E,'^[h{Y,^_^^)\J^T] is actually y^-measurable. First note 
that without impulses, because f3{—t,uj) = /3(F"(t— )), the SDK solution Y^ has the 
strong Markov property by the above cited results; we denote by F^(|/, t,t + u) this SDK 
solution started at t > in evaluated at t + u. 

Wlog, all Ti > T, e.g., ri first exit time after T. We split into the cases Aq := {ri > T + u}, 
Ai := {ti < T + u < T2}, A2 := {t2 <T + u< t^}, .... The case ti > T + u is clear by 
the above. For Ai, 

EyiuMYT+JlJ^T] = Ey[uMHyT+u)\^rA\^T] 

Because ri is first exit time after T (and thus T+u—ti independent of T), and Y^__ includes 
the time information Ti as first component, the SDK solution Y'^(r{Y^_, (i),Ti,T + u — ri) 
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depends only on Y^_. Thus we can conclude that there are measurable functions gi,gi 
such that 

where {Y^j^^_Y^ is the process stopped in ri, which is a strong Markov process by Dynkin 



231 1. Th. 10.2 and the fact that ri is the first exit time. 



For yl2, following exactly the same arguments, there are measurable functions QiiQi such 
that 



W[IaMY^^u)\^t] 



EnU,E'^[(72(F^(r(F° , Ci), ri, - ri))| J-.J| J-^] 



W[UM{Y^+u^ 



T\ 



9i{Y^] 



where we have used that T2 is the first exit time after ti. The result follows by induction 
and the Dominated Convergence Theorem. □ 

Dynamic Programming Principle. An important insight into the structure of the 
problem is provided by Bellman's dynamic programmin g p rinciple (DPP). Although the 
DPP is frequently used (see, e.g., 0ksendal and Sulem 39|, Ly Vath et al. (H]), we are 
only aware of the proof by Tang and Yong j48| in the impulse control case (for diffusions). 
We show here how the DPP can formally be derived from the Markov property. 

By the strong Markov property of the controlled process, we have for a stopping time 

f < T {t = Ts OT T = Ts AT): 



X 



Tj<T 



T<Tj<T 

= E(*'-) I /(., X:, (3,)ds + Y Kir,, X:^_, Q) + J^^\f, X?_) | (16) 
< E(*'-) i r /(., X:, (5,)ds + J2 K{r„ K,-. Q + v{f, X?_) ) (17) 



Tj<T 



Note especially that the second J in (|T6i) "starts" from Xr-, i.e. from X before applying 
the possible impulses in f - this is to avoid counting a jump twice. Xf instead of Xf_ 
in 0161) would be incorrect (even if we replace the = by a <). However, J*^"^(f,Xf_) < 
v{f,Xf) + K{f, Xf-X)^ {impulse in f} holds because a (possibly non-optimal) decision to 
give an impulse ( in f influences J and v in the same way. So we have the modified 
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inequality 



To <T 



We will use both inequalities in the proof of Theorem 14.21 (viscosity existence). 

The above considerations can be formalised in the well-known dynamic programming 
principle (DPP) (if the admissibility set A{t,x) satisfies certain natural criteria): For all 

f < T 



v(t, x) 



sup E(*'") 

aeA{t,x) 



r /(s, p,)ds + J2 K{t,,X:^_, 0) + v{f, X?) 



(19) 



The inequality < follows from f|T8|) and by approximation of the supremum. The inequality 
> in f[T^ is obvious from the definition of the value function, basically if two admissible 
strategies applied sequentially in time form a new admissible strategy (see also Tang and 
Yong 481]). (Of course a similar DPP can be derived from (|T7|) .) We do not use the DPP 
(|T9|) in our proofs. 



4 Existence 

In this section, we are going to prove the existence of a QVI viscosity solution in the elliptic 
and parabolic case. Because a typical impulse control formulation will include the time, 
we will first prove the existence for the parabolic form, then transforming the problem 
including time component into a time-independent elliptic one (the problem formulation 
permitting). 



4.1 Parabolic case 

Recall the definition of := [0, T) x 5 and its parabolic "boundary" (9+5t := ([0,T) x (M"' \ 
({T} X M'^) . We consider in this section the parabolic QVI in the form 

min(— sup{n( + L^u + f^}, u — Mu) = in St 

min(n — g,u — Aiu) = in d'^ St 

for L'^ from ([9]) the integro-differential operator (or infinitesimal generator of the process 
X), and the intervention operator Ai selecting the optimal instantaneous impulse. 

Let us now define what exactly we mean by a viscosity solution of ([8]). Let LSC{Q) 
(resp., USC{fl)) denote the set of measurable functions on the set Q that are lower semi- 
continuous (resp., upper semi-continuous). Let T > 0, and let u* (m*) define the upper 
(lower) semi-continuous envelope of a function u on [0, T] x Mf^, i.e. the limit superior 
(limit inferior) is taken only from within this set. Let us also recall the definition of VB 
encapsulating the growth condition from section [2]). 
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Definition 4.1 (Viscosity solution) A function u E VB{[0,T] x R'^) is a (viscosity) 
suhsolution of ^ if for all {to,Xo) e [0,r] x M'^ and ip e VB f] C^'\[0,T) x M'^) with 
ip{to,Xo) = u*(to,XQ), ip >u* on [0,T) x R'^, 



mm 



min {u* — g,u* — Mu*) < in {to,xo) E d'^ St 

A function u G PS([0,T] x W^) is a (viscosity) supersolution of ([^j if for all (tQ,xo) G 
[0,T]xM"' andifi E VBr]C^'^{[0,T)xR'^) with (p{to, xq) = u4to,xo), ^<u^on [0,T)xM"', 

min ( -sup 1^ + i'^V^ + /^l - A^n* ) > m (to, Xq) G 5^ 
\ P&Bldt J J 

mm{u^ — g,u^ — Mu^) > in {to, xq) E St 
A function u is a viscosity solution if it is sub- and supersolution. 

The conditions on the parabohc boundary are included inside the viscosity solution def- 
inition (sometimes called "strong viscosity solution", see, e.g., Ishii [29|]) because of the 
implicit form of this "boundary condition". In T, we chose the implicit form too, because 
otherwise the comparison result would not hold. The time derivative in t = is of course 
to be understood as a one-sided derivative. 

Now we can state the main result of the section, the existence theorem: 

Theorem 4.2 (Viscosity solution: Existence) Let Assumptions \2.1\ and \2.B be sat- 
isfied. Then the value function v is a viscosity solution of ^ as defined above. 



For the proof of Theorem 14.21 we rely mainly on the proof given by [35| , extending it to 
a general setting with jumps (compare also the sketch of proof in 0ksendal and Sulem 
|39| ) . We need a sequence of lemmas beforehand. The following lemma states first and 
foremost that the operator A4 preserves continuity. In a slightly different setting, the first 



two assertions can be found, e.g., in Lemma 5.5 of [35 



Lemma 4.3 Let (\{J^, (\{^ be satisfied for all parts except Letu be a locally bounded 
function on [0,T] x M.'^. Then 

(i) Mu, E LSC{[0,T] X M^) and Mu, < (Mu), 

(ii) Mu* E f/5C([0,T] X M^) and {Muf < Mu* 

(m) Ifu< Mu on [0,T] x R'^ , then u* < Mu* on [0,T] x R'^ 

(iv) For an approximating sequence {tn^Xn) (t,x), {tn,Xn) C [0,T]xM'^ withu(tn,Xn) 
u*(t,x): If u*{t,x) > Mu*{t,x), then there exists N E N such that u{tn,Xn) > 
Mu{tn,Xn) Wn>N 
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(v) M. is monotonous, i.e. foru > w, Aiu > Aiw. In particular, for the value function 
V, A4^v < V for all n > 1 

Proof: (ji]): Let (tn,Xn)n be a sequence in [0,T] x M'^ converging to {t,x). For an e > 0, 
select G Z{t, x) with u^{t, T{t, x, C^)) + K{t, x, O + e > M.u^{t, x). Choose a sequence 
C,n — )■ with Qn G Z{tn,Xn) for all n (possible by Hausdorff convergence). Then 

Yimmi Mu^{tn,Xn) > liminf r(t„, X„, (n)) + K{tn,Xn,Cn) 

> u^{t, r{t, X, O) + K{t, X, C) > Mu^{t, x) - e. 

The second assertion follows because M.u > Aiu^,, and thus (A^n)* > (A^n*)* = ^Au^,. 

([HD: Fix some {t,x) G [0,T] x M"', and let (t„,x„) G [0,T] x M'^ converge to 
Because of the upper semicontinuity of u* and continuity of F and K, for each fixed 
n, the maximum in A^M*(t„,x„) is achieved, i.e., there is ^ Z(tn,Xn) such that 
Mu*(tn,Xn) = u*(tn,T{tn,Xn,Cn)) + -ft'l^n, ^^n, Cn) • (Cn)n IS Contained in a bouudcd set, 
thus has a convergent subsequence with limit ( G Z(t,x) (assume that ( ^ Z(t,x), then 
dist{(, Z(t,x)) > 0, which contradicts the Hausdorff convergence). 
We get 

Mu*{t,x) > U*{t,T{t,X,C)) + K{t,X,C) >\imSUpU*{tn,T{tn,Xn,Cn))+K{tn,Xn,Cn) 

n—^oo 

= limsup A^u*(t„, x„,) 

n—^oo 

The second assertion follows because Mu < Mu*, and thus (Mu)* < (Mu*)* = Mu*. 

dm]): Follows immediately by dn]): If m < Mu, then u* < (Mu)* < Mu*. 

fliv|) : By contradiction: Assume M(t„,x„) < Mu{tn,,Xn) for infinitely many n. Then by 
convergence along a subsequence, 

u*{t,x) < limsup A^u(t„,, x„) < {Mu)*{t,x) < Mu*{t,x). 

n—>-oo 

dvj): The monotonicity follows directly from the definition of A^. A^t; < is necessary 
for the value function v, because v is already optimal, and M^v < v for all n > 1 then 
follows by induction. □ 

By (MI]), (V|2]) of section m we obtain that Mv(t,x) < oo if locally bounded. This 
finiteness and the property that there is a convergent subsequence of (Cn) are sufficient 
for dn]) (at least after reformulating the proof). 

The existence proof frequently makes use of stopping times to ensure that a stochastic 
process X (started at x) is contained in some (small) set. This works very well for 
continuous processes, because then for a stopping time r = inf{t > : — x| > pi} Ap2, 
the process \Xt- — x\ < pi. For a process including (non-predictable) jumps however, 
\Xr — x\ may be > pi. Luckily, Levy processes are stochastically continuous, which 
means that at least the probability of X^ being outside B{x,pi) converges to 1, if p2 — ^ 0. 
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Stochastic continuity as well holds for normal right-continuous Markov processes (see 
Dynkin 23l|, Lemma 3.2), and thus for our SDE solutions. 

The lemma (Lemma 17.21 in the appendix) destined to overcome this problem essentially 
states the fact that stochastically continuous processes on a compact time interval are 
uniformly stochastically continuous. A further lemma (Lemma 17. ll in the appendix) shows 
that for a continuously controlled process, stochastic continuity holds true uniformly in 
the control (this is of course a consequence of (EllD)- 

Now we are ready for the proof of the existence theorem. Recall that a necessary condition 
for the value function on the parabolic boundary d~^ST is 



mm f 



{v-g,v-Mv) = in [0,T) X (M'^\^). 



m 



Proof of Theorem 14. 2t v is supersolution: First, for any {to,Xo) E [0,T] x R.^, 
the inequality v(to,XQ) > J\4v{to,XQ) holds, because otherwise an immediate jump would 
increase the value function. By Lemma H73] fli|) . AiV:>,(to,Xo) < {Aiv)^(to,Xo) < v^(to,Xo). 

We then verify the condition on the parabolic boundary: Since we can decide to stop 
immediately, v > g on St, so > g follows by the continuity of g (outside S) and 
requirement (E]3]) (if Xq G dS or to = T). 

So it remains to show the other part of the inequality 



(20) 



in a fixed {to,xo) G [0, T) x 5, for ^ e VBnC^'^{[0,T) xR"^), </?(to,a;o) = v^{to,xo), f < 
on [0,T) X M"^. 

From the definition of v^,, there exists a sequence (tn, Xn) G [0, T) x S such that {tn, Xn) 
(to,Xo), v(tn,Xn) v^{to,xo) foT w -> oo. By Continuity of ip, 6n := v(tn,Xn) - (p(tn,Xn) 
converges from above to as n goes to infinity. Because (tQ,xo) G [0,T) x S, there exists 
p > such that for n large enough, tn < T and B{xn, p) C B{xo, 2p) = {\y — xo\ < 2p} C 
S. 

Let us now consider the combined control with no impulses and a constant stochastic 
control /3 G -B, and the corresponding controlled stochastic process X^'^"'^" starting in 
{tn,Xn)- Choose a strictly positive sequence (/i„) such that /?,,„ — and Sn/hn — as 
n — )■ oo. For 

fn := inf {s > tn : jX'^'*-"" - Xn\ >p}A {tn + hn) A T, 

we get by the strong Markov property and the Dynkin formula for p sufficiently small 
(E" = E^*"'^"^ denotes the expectation when X starts in tn with Xn)'- 



v{tn,Xn) > / f{s,X^,P)ds + v{fn,Xi_) 

> E" / f{s,X^,P)ds + ip{fn,Xi.) 

= ip{tn,Xn)+'E 



dip 



f{s, Xf , /3) + -^ {s, Xf ) + L^(., Xf ) ds 
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Here, our assumptions on the SDE coefficients of X were sufficient to apply Dynkin's 
formula because of the localizing stopping time f„. Using the definition of we obtain 



> E" 



n Jt 



fis,X^,(3) + ^(.,Xf) +LV(^,^f) ds 



(21) 



Now, we want to let converge — )■ oo in (^T^, but it is not possible to apply the mean 
value theorem because s i— )■ f{s,X^,l3) (for fixed u) is in general not continuous. Select 
e e (0,p). By Lemma 17^ P(supi^<^<^ ^j^p,tn,x„ _ ^ _^ q fQj, ^ | Define now 



= {u : sup |xf - a;„| < e}. 



and split the integral in ( ]2T|) into two parts 



tn~\~h'r 



On An^g, for the integrand G of the right hand side in fl2T 



1 Ptn+hn 



1 rtn+hn 

< Y / |G(to,xo,/3)-G(s,Xf,/3)|cis 



(22) 



the latter because G is continuous by (MS]) and assumption on and the maximum 
distance of \G{tQ,XQ, fi) — G(-,-,/3)| is assumed in a {tn,eiin,e) ^ [^n,^n + ^n] x B^Xn^e)- 
On the complement of v4„ e. 



lyic ^ < ess sup 



/(.,Xf,/3) + ^(.,Xf)+LM^,Xf) 



1a= ) 



which is bounded by the same arguments as above and because a jump in r„ does not 
affect the essential supremum. 

Because /i„ — )■ and (t„,x„) — j- {tQ,Xo) for n — )• oo and by stochastic continuity, 
^{^n,s) 1, for all e > or, equivalently, lA„,e ~^ ^ almost surely. So by n — )■ 
oo and then e — )■ 0, we can conclude by the dominated convergence theorem that 
/(to, xo, (3) + ^(to, a;o) + L^</'(to, xq) < V/3 e S, and thus ([20D holds. □ 



V is subsolution: Let {to,xo) G [0,T] x M'^ and G Pi3 n Ci'2([0,T) x R"') such 
that v*{tQ,XQ) = (p(to,xo) and (p > v* on [0,T) x M"'. If v*(to,xo) < Mv*(to,xo), then 
the subsolution inequality holds trivially. So consider from now on the case v*{to,xo) > 
Mv*{to,xo). 

Consider (to, 2:0) G d~^ST- For an approximating sequence (t„,x„) — )■ (to,Xo) in [0,T] x 
with v(tn,Xn) — t'*(to,Xo), the relation f(t„,x„) > A^f(t„,x„) holds by Lemma (livl) . 
Thus by the continuity of g (outside S) and requirement (E]3]) (if xq G 95* or to = T), 

g(to,xo) = lim g(tn,Xn) = lim w(t„,x„) = w*(to,xo) 
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Now let us show that, for v*{tQ,xo) > Aiv*(tQ,xo), 

-sup{^ + L^ + /}<0 (23) 

in (to, xq) G [0, T) X S. We argue by contradiction and assume that there is an > such 
that 

sup + L"^ + /A < _^ < (24) 

Because ip G VB fl C^'^([0, T) x M'^) and the Hamiltonian is continuous in (t, x) by (MSj), 
there is an open set O surrounding (tg, Xq) in St where sup^g^ + ^^V' + /^} < ~v/'^- 

From the definition of t^*, there exists a sequence (t„, a:„) G St H O such that (t„, x„) — j- 
(^0,3^0)5 v(tn,Xn) — )■ w*(to!3;o) for 77, — >■ 00. By continuity of ip, again 5„ := t;(t„,a;„) — 
ip{tn,Xn) converges to as n goes to infinity. 

By definition of the value function, there exists for all n and 5 > (choose e = En with 
En iO) a. combined admissible control a" = ^"(e) = (/3",7"), 7" = (T",Cr)i>i such that 

v{tn,Xn) < J^''"\tn,Xn)+E. (25) 



For a p > chosen suitably small (i.e. B{xn,p) C B{xo,2p) C S , tn + p < + 2p < T 
for large n), we define the stopping time f„ := A r", where 



:= inf{s > : |Xf - x„| > p} A (t„ + p). 

We want to show that f„ — in probability. From fl2Sl) combined with the Markov 
property (ITTj) . it immediately follows that (again E" = E'^*"''^"\ and /3 = a = a"^ 

y(t„,x„) < E'^ / /(s,Xf,/3,)t/s + ^(r„,x4_) +En 

-'J in 

Thus by Dynkin's formula on ip{fn, X^^_) and using v{tn,Xn) = (p{tn,Xn) + 5n, 



(26) 



6r,. < E" 



where for p small enough, we have applied ( |24|) . This implies that lim„_j.oo IE[r„] = 
which is equivalent to f„ — to in probability (as one can easily check with Chebyshev's 
inequality; f„ is bounded). 

•^In the following, we will switeh between a and (3 in our notation, where the usage of /3 indicates that 
there is no impulse to take into account. 
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Now let us continue with our proof. In the following, we make again use of the stochastic 
continuity of X^"'*"'^" (up until the first impulse). We define 

An{p) = {u : sup |Xf"'*"'^" - Xn\ < p} 



+ en (27) 



25|) combined with the Markov property f jlSj) gives us 



v{tn,Xn) < 



To find upper estimates for v{tn^Xn)^ we use indicator functions for three separate cases: 

< rn (I) 
{ff: > rn n A^ipY (II) 

{fi: > rn n A^ip) (III) 

(III) is the predominant set: For any sequence (e„), by basic probability P(f^ > r") > 
1 - F{fP < in) - P(ri" > in). Choose in i to such that F{t^ > in) 0. By Lemma O 
(Imj) (wlog, we need only consider the setting without impulses), also lim sup„_^oo P(f^ < 
in) = 0. In total, we have P(J//) — 1 or 1(7//) — 1 a.s. for n — > oo. 

Thus, using that if there is an impulse in f„ (i.e. > ), then f (f„, X^^)+K{fn, ^4-' Cr) — 

Mv{fn,Xl_)E 

v{tn,Xn) < sup f (t' , y' , l3t')E[fn - tn] 

\t'-to\<p 

+ E[\v{fn,Xi)\l^j)]+E[\Mv{fn,xL)\kn)] 
+ sup Mv{t',y')El(^jjj) 

\t'-to\<p 
\y'-XQ\<p 

To prove the boundedness in term (I) (uniform in n), we can assume wlog that //(M'^) = 1, 
and consider only jumps bounded away from for xq > 0. Then by (EH]), E sup„ \v{fn, X^^)\ < 
C E[l + R{xo + 2p + Y)] for a jump Y with distribution iy<^ito+2p,xo+2p,(s,-) ^ which is finite by 
the definition of VB. The same is true for Jliv{fn, X^^_) (for Aiv > because A4v < v, 
for negative Aiv this follows from the definition). 

Sending n — oo (limsup„_^oo), the /-term, and term (I) converge to by the dominated 
convergence theorem. For term (II), a general version of the DCT shows that it is bounded 
by 

E[limsup |7Wt;(f„,X^^_)|lA„(p)c], 
and term (III) becomes sup Aiv{t' ,y'). Now we let p — ?■ and obtain: 

v*{to,xo) < lim sup Mv{t',y') = {Mv)*{to,xo) < Mv*{to,xo) 

piO \t'-to\<p 

\y' ~Xg\<p 



"'Note: More than one impulse could occur in r„ if the transaction cost structure allows for it (e.g., K 
quadratic in In this case however, the result follows by monotonicity of A4 (Lemma 14.31 ( [v | ) 
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by Lemma H73l dH]), a contradiction. Thus ( 123|) is true. 



□ 



Let us elaborate on some details of the proof: 

• In the proof, we have only used that all constant controls with values in B are 
admissible for the SDE ([2]). So actually, we are quite free how to choose the set of 
admissible controls - the value function always turns out to be a viscosity solution. 

• Another approach for the subsolution part would be tempting, although we do 
not see how this can work: In the subsolution proof, we assumed v*(to,Xo) — 
A4v*{to,xo) > 0. This implies, using Lemma 14.31 (!iv|) and the 0-1 law, that for 
n large enough, > t„ a.s. On the other hand, from fn to, it follows by Lemma 
17. II that r" — )■ to in probability (it is sufficient to consider the setting of Lemma [7. II 
without impulse, since otherwise the first impulse would anyhow converge to in 
probability). So the convergence of points already to a contradiction. 

• By local boundedness of v, the derivation of the dynamic programming principle and 
the integrability condition ([6]), we could already deduce that W"'^"[v{fn, X^^)] < oo; 
it is however not so easy to deduce this uniformly in n. The condition ([6]) contains 
implicitly conditions on u we have formalised in (MI]). 

We promised to come back to the "regularity at dS" issue, and present here conditions 
sufficient for condition (EE]). 

(El*) For any point (t,x) G [0,T) x dS, any sequence {tn,Xn) C [0,T) x 5", {tn,Xn) — )■ 
{t,x), and for each small e > 0, there is an admissible combined control a„ = 
{(3n,1n) such that 

v{tn,Xn)<J^''"\t^,Xn)+e, (28) 
and such that for all 6 > 0, P(f^ < t„ + 5) — )■ 1 for n — ?• oo (where = inf{s > 

tn : X''-*"'^"(s) ^ S}). 

(E2*) For any point {t,x) G d*ST, if there is a sequence (t„,a;„) C [0, T) x S converging 
to (t,x) with v(tn,Xn) > Aiv(tn,Xn), then there is a neighbourhood of {t,x) (open 
in [0,T] X W^), where v > Mv 

Example 4.1 Let X be a one- dimensional Brownian motion with a > 0, and assume 
it is never optimal to give an impulse near the boundary. Then (^J\*) and (I^*) are 
satisfied. 

We define = inf{s > t^ : X""'*"'^"(s) ^ S}. 

Proposition 4.4 Let r = Ts or r = Ts AT . If (I^*) and (1^*) hold, and for n large the 
integrability condition 

r \f{s,X^", {f3n)s)\ds + |<7(r,X,"")| W + Yl \K{TlX:^_,g)\ <he L\¥;R) 
is satisfied, then (I^ holds. 
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Proof: Let (t, x) G [0, T) x dS and assume wlog that v > Aiv in a neighbourhood of 
(t, x). Then we have to show for all £ > and all sequences chosen as in (EUT), that 



I'TS 



f{s,X':-,{(5n)s)ds + g{Ts,X'^-{Ts))l 



Tg<00 



Tj<TS 



(29) 



as n — )■ oo, 5 — )• 0. For the set 



Bn,5 := {Ts < tn + 6} n { SUp - X„| < 5}, 

in<t<r^ 

we claim that for all 5 > small enough, 1b„ ^ — ?■ 1 as n — )■ oo. To see this, first note that 
by assumption and Lemma 17.21 f lmj) , this is true for the set 



Bn,5 ■■= {fs <tn + S}n{ sup 



t„<t<fV. 



- Xn\ < 5}. 



Choose 5 small enough such that v > Aiv on B{xn,S) and x G B{xn,S) for all n large. 
Then it is easily checked that {supj^<^<^n ^^a„,t„,x„ _ < = |sup 
Xn\ < S}. Because 



P < t„ + 5 



sup |X, 



P f ^ < t„ + 5 



tn<t<Tn 



sup |Xj 



- x„| < (5 1, 



we can conclude that 1b„ ^ — ?■ 1 as n — )■ oo for 5 > small enough. 

The convergence in fl2I?]) then follows just as in the existence proof, by splitting into Bn^s 
and B^^ and applying the limsup, liminf versions of the DCT, first for n — )■ oo, and 
then for 5 — )■ (using the continuity of f,g). The result for t = T holds by the same 
arguments, because time is always regular. □ 

Remark 4.1 (I^ (resp, (I^*)) excludes in particular problems with de facto 

state constraints, where it is optimal to stay inside S . We note however that the framework 
presented here allows for an adaptation to (true and de factoj state constraints, which 
can be pretty straightforward for easy constraints. Apart from the stochastic proof that 
we can restrain ourselves to controls keeping the process inside S, the adaptation involves 
changing the function w used in the uniqueness part, such that only values in S need to 
be considered in the comparison proof. For an example in the diffusion case, see Ly Vath 
et al. fSa l: jumps outside S however may be difficult to handle. 



4.2 Elliptic case 

The existence result for the elliptic QVl f|T3|) now follows from the parabolic result by an 
exponential time transformation. Recall that the elliptic QVI is 

min(-sup{L^u + /^},n-A^n) = 0, (USD 

I3£B 
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for the elliptic integro-differential operator from (iMl) and the intervention operator Ai 
selecting the optimal instantaneous impulse. 

For an s > and p > 0, let the functions as used in section H?T] be tagged by a tilde. /, 
g, K are all built in the same way on [0, oo) x M'^, as the following example: 

/(t,a;,/3) = e-^(^+*)/(x,/3) 

Let r = r (independent of t) and likewise /i, a, i and the transaction set Z. The interven- 
tion operator including time (as in section |4?T|) is denoted by A^, and the time-independent 
one is defined by 



Mu{x) = sup{M(r(a:, 0) + K{x, () : ( e Z{x)}, 

integro-differential operator (or infinitesir 
used in section HIT] (in this case is not equal to e~''^^~^^''L^). 



Let denote the integro-differential operator (or infinitesimal generator) from ([9]) as 



It can be checked that the assumptions of section 14.11 hold for the tilde functions, if the 
corresponding assumption holds for the time-independent functions without tilde. As 
well, all the lemmas used for the proof of the existence theorem are still valid in the 
time- independent case. 

Definition 4.5 (Viscosity solution) A function u G VB{W^) is a (viscosity) suhsolu- 
tzon of ^^ if for all xq G K"' and cpeVBn C^{R'^) with ^{xq) = u*{xo), (p > u* , 

min ( -sup {£''V9 + /^} ,M* - A^M* ) < in xq e S 

V l3eB J 

min {u* — g,u * - Mu*) < mxoeR'^'\S 

A function u G VB{W^) is a (viscosity) supersolution of / fl^) if for all xq G M'^ and 
^ eVBn C2(R'^) with (p{xo) = n*(xo), (p < u^, 



min I — sup {L^^p + Z'^} , m* — A^m* ) > in xq E S 

min (m^, — (yf, M^, — A^M^,) > inxQEW^\S 
A function u is a viscosity solution if it is sub- and supersolution. 

In the original problem on [0, oo) X M'^, we only consider Markov controls that are time- 
independent, i.e., only depend on the state variable x. Denote by v the then resulting 
value function of the parabolic problem on [0, oo) x M.'^. Then we can define the time- 
independent value function 

v{x) ■.= eP^'+'^v{t,x). (30) 

Let us emphasise that this definition is only admissible if the right-hand side actually does 
not depend on t, which can be checked in the definition of J^°'\t^x) by the homogeneous 
Markov property (and of course only if the time horizon is infinite, i.e., r = ts ioi S C. W^). 

The existence of the elliptic QVI then follows by an easy time transformation: 
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Corollary 4.6 Let Assumptions \2.1\ and \2.S\ be satisfied. Then the value function v as 
defined above is a viscosity solution of l[T^) . 



Proof: We know from Theorem 14.21 that w is a (parabolic) viscosity solution of ([H]) on 
[0,00) X M.'^ (without the terminal condition), i.e. of 

min(— sup{u( + L^u + /^}, u — A4u) = in {to, Xq) G [0, 00) x S 

(31) 

min(M - g,u- Mu) = in {to, Xq) G [0, 00) x {W^ \ S) 

For the subsolution proof, let ip G VB fl C^(M"') with (p{xo) = v*{xo), ip > v*. For 
(p{t,x) := e~''^*"''*V(^) fo^^ t>Q, ip{to,Xo) = v*{to,Xo) and > v*. Furthermore, 

By the definition of the elliptic Ai, we have v—Aiv = e~P^^~^^'^{v—Aiv). The supersolution 
property is proved in the same manner. □ 



5 Uniqueness 



The purpose of this section is to prove uniqueness results both for the elliptic and the 
parabolic QVI by analytic means. Using such a uniqueness result, together with the 
existence results of section HJ we can conclude 



The viscosity solution of the QVI is equal to the value function. 



We were inspired mainly by the papers Ishii [29|] (for the impulse part) and Barles and 
mbert [sl (for the PIDE part). As general reference for viscosity solutions, Crandall et al. 
lil was used and will be frequently cited. Some ideas have come from jssi, 39], [l| and 
3. 

In this section, v does not denote the value function any longer, and some other variables 
may serve new purposes as well. 

First, we will investigate uniqueness of QVI viscosity solutions for the elliptic case (the 
parabolic case following at the end): 

min(-sup{L^M + - A^m) = in 

min(M - g,u- Mu) = in M"* \ S" 



5.1 Preliminaries 

Whereas in the last section, we did not care about the specific form of the generator (as 
long as the Dynkin formula was valid), we now need to investigate the operator more 
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F{x,r,p,X, {Ip)) 


= — sup 

l3eB 




■ 


J \z\<S 






J\z\>S 


Xp[x,4>] 


= Xg' [X. 



in detail: 

L^u{x) = ^tr {a{x,(3)a^{x,P)D\{x)) + {fi{x, P),Vu{x)) - c{x)u{x) 

+ j u{x + i{x,(3,z)) -u{x) - {Vu{x),i{x,(3,z))li,i<iu{dz), (32) 

where c is some positive function related to the discounting in the original mo delEl 

We recall the definition of the function space VB = VB{R'^) from section [21 such that 
the differential operator is well-defined for G VB fl C^(]R'^). Denoting for < 6 < 1, 
y,peR'^, X e M'^^'^, r e M and (//3)/3gB C M: 

^tr {a{x, P)a^{x, /3)X) + {fi{x, f3),p) - c{x)r + f{x, /3) + I 

(x + e{x, /3, z)) - 0(x) - (V0(x), £(x, /3, z)) v{dz) 

{x + £(x, /3, z)) - </)(x) - (p, £(a;, /3, 2;))l|^|<i v{dz) 

6]+X^''[x,V0(x),0], 

we have to analyse the problem 

min(F(x, m(x), Vm(x), D^M(x),Xg[x, «(■)]), m(x) — M.u{x)) = 0, 

where the notation u{-) in the integral indicates that nonlocal terms are used on u, not 
only from x. As well, I^lx, u{-)] within F always stands for a family (/3 G B) of integrals. 
Denote by the function F without the sup, i.e. for a concrete (3. 

Remark 5.1 The following properties hold for our problem: 

(PI) Ellipticity ofF: F{x,r,p,X\ {l})) < F{x,r,p,X\ {I})) if X^ > X\ l}>l}y/3eB 

(P2) Translation invariance: u — J^u = {u + I) — J^{u + I) , I[yo, 4>] = I[yo, (p + I] for 
constants I G M 

(P3) {l/3)/3 ^ F{x,r,p, X, (/^)) is continuous in the sense that 

\F{x,r,p,X, (ID) - F{x,r,p,X, (/^))| < sup \ll - /^j. 

The last statement - proved by easy sup manipulations - is just for the sake of complete- 
ness; we will not use it explicitly because uniform convergence needs continuous functions, 
which in general we do not have. 



^Note that the normal definition of a Levy integral is with the indicator function l|z|<i; this is however 
equivalent 
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For X & S and 6 > 0, recall the definition of Us = Us{x) = {£{x,/3,z) : \z\ < 6}. Us 
facilitates splitting the integral Xg[x, 0]: changing on Us{x) only affects and 
reversely. 

Let henceforth Assumptions 12.11 and 12.31 be satisfied (the latter needed mainly for the 
equivalence of different viscosity solution definitions). Further assume 

(Ul*) c is continuous 

Remark 5.2 It is sufficient for the comparison theorem if Assumption l27^ holds only for 
small 6 > 0: "For any Xq, there is a small environment and a5>0, where the assumption 
holds for < 6 < 6. . . ." This is why we will carry out all proofs for i depending on (3 in 
the following. 

Immediately from (MS]) and (lUF), it follows that sup^g^ a{x, /3) < oo, and by sup manip- 
ulations that {x,r,p,X) i— )■ F{x,r,p,X,lj3) is continuous; but even more can be deduced: 

Proposition 5.1 Let {f3k) C B with (3k — (3, and (xk), {pk) C with Xk ^ x ^ S, 
Pk P- 

(i) IfueVBn USC{R'^) and v e VB n LSC{R'^) with u{xk) u{x), v{xk) v{x), 
then 

limsupX^;^'^[xA..,PA.-,^i(-)] <^f^[x,P,u{-)], hmmiX^f[xk,Pk,v{-)] > Xf^[x,p,v{-)]. 

Moreover, for {(pk), {i'k) C VB fl C^(M"') with ^ u and ipk ^ v monotonously, 
^k{xk) u{x), i)k{xk) v{x), 

limsup J^^''[xfc,pfc,v2fc(-)] <xY[x,p,u{-)], \imm{Xy^[xk,Pk,i^k{-)] > Xj''^[x,p, t'(-)]- 

fc— ^oo fc— >-oo 

(a) If E C^(M°'), then {x,(3) i— )■ Zjj'^[x, ip{-)] is continuous. Moreover, for {(fk) C 
C'^iW^) with ipk ^ monotonously, ipk = in an environment of x, 

lim llf[xk,ipki-)] =Ty[x,!f{-)]. 

fc— s>oo '^'^ 

(ill) Ifu e VBr}USC{W^) andv e VBr\LSC{R'^), {cpk), {ipk) C VBnC^iR'^) with^k ^ u 
and tpk V monotonously, ipk = u ^ C"^ and ipk = v & C'^ in an environment of x, 
then 

\iiii-uiiF^^{x,r,p,X,Xp^[xk,^k{-)]) > F^{x,r,p,X,Ip[x,u{-)]) (33) 

fc— >oo 

\unsnpF^'{x,r,p,X,Iis,[xk,M-)]) < F^{x,r,p,X,Ip[x,v{-)]) (34) 

k—>oo 

(iv) If u e VB nUSOR'^), if e C\R'^), then (3 ^ -F^(x, r,p, X,X^'^[x, </?(■)] + 
Zp' [x,p,u{-)] is in USC(R ). In particular, the supremum in 13 E B is assumed. 
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Proof: dl]): We prove only the first statement for u G USC (the Isc proof being 
analogous). By a general version of the DCT and the definition of VB, 

limsup / u{xk + £ixk,f3k,z)) -u{xk) - {Pkj{xk,/3k,z))l\z\<i'y{dz) 

fc— >-oo J\z\>S 



< / Mmsup u{xk + i{xk, (3k, z)) -u{xk) - {pkJ{xk,Pk,z))l\^\<iu{dz) 



< / u{x + i{x, z)) — u{x) — {p,i{x, 13, z))l\z\<ii^{dz), (35) 

J\z\>S 

where we have used the continuity of i (M3]). The fact for ipk follows because by mono- 



tonicity of {(pk), and a general version of Dini's Theorem (cf. DiBenedetto 22|, Th. 7.3), 

\imsupk^oc¥^k{xk + £{xk,/3k,z)) < u*{x + i{x, /3, z)). 

([n]): Outside of the singularity of u, the result follows from (ji]). In the environment of x, 
the Taylor expansion (1121) gives the upper bound for the application of the DCT (where 
the local boundedness of ^5(2;) holds by (VS]). 

dm]) follows immediately from Finally, ( liv|) holds by the continuity conditions 

(Mi, (U[ff) and (0), (Hi. □ 



5.2 Viscosity solutions: Different definitions 

Let us now restate in the new notation the definition of viscosity solution in the elliptic 
case (equivalent thanks to the translation invariance property): 

Definition 5.2 (Viscosity solution 1) A function u G VB is a (viscosity) suhsolution 
of / f73'|) if for all Xq G M"' and if G VB fl C'^{W^) such that u* — if has a global maximum 
in xo, 

min [F(xo,u* ,Vif, D'^Lp,Il3[xo, ^{■)]),u* — Aiu*) < in xq E S 

min [u* — g,u * - Mu*) < tnxoe {R"^ \ S) 

A function u G VB is a (viscosity) supersolution of l[T3\) if for all Xq G M"' and if G 
VB n C^(R'^) such that — has a global minimum in Xq, 

min [F{xo,u^,V(p, D'^(p,If^[xo,(p{-)]),u^ - Mu^) > in Xq E S 

min (u* — g,u^ — M.u^) > in Xq E {W^ \ S) 

A function u is a viscosity solution if it is sub- and supersolution. 

As in j^, we give two equivalent definitions, the latter one is needed later on in the 
uniqueness proof: 
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Definition 5.3 (Viscosity solution 2) A function u G VB is a (viscosity) subsolution 
of (123) '^f fof^ (ill G M'^ and (p G C^(M'^) such that u* — ip has a maximum in Xq on 
Usixo), 

min ^F(xo, u*, Vv?, i5^V',X^''^[xo, V5(0] + 2^^'''[2^0; Vv?, ^* ~ < in xq e S 

mill {u* -g,u* - Mu*) < zn Xq G (M*^ \ S) 

A function u G VB is a (viscosity) supersolution of / f73]) if for allxQ G and ip G C^(M"') 
stic/i i/ifli — (p has a minimum in xq on Us{xo), 

mm (^F{xo,u^,V(p,D'^Lp,lj^'^[xo,ip{-)]+X'^'^[xo,V(p,u^{-)]),u^ — Mu^^ > in xq E S 

mill {u^ — g,u^ — Aiu^) > in Xq E (R.'^ \ S) 
A function u is a viscosity solution if it is sub- and supersolution. 



Note that the definition is of course still valid if Us{xo) fl (W^ \ S) 7^ 0. That the two 
definitions are equivalent is essentially not a new result; for proofs in simpler settings, see 
Alvarez and Tourin Jakobsen and Karlsen 30 



Proposition 5.4 Definitions 1 and 2 are equivalent. 



Proof: We treat first the subsolution part. Because u* — M.u* < holds independently 
of the viscosity formulation, so of the case distinction, we need only consider the PIDE 
part for xq G S. (Note that for uiM.^) < 00, we can set 5 = 0, and use in the following an 
arbitrary local environment of Xq instead of Us{xo)-) 

"<^=" Assume m is a viscosity subsolution according to Definition 2. Let xq E S and 
(p E VB n C^(M'^) such that u* — (p has a global maximum in xq. Then xq is also a 
maximum point on Us{xo). So 

F(xo, u\ Wip, DV, <^(-)] + 2-J'[xo, Vv^, u*{-)]) < 

By the property Xg' [xq, Vy?, «*(■)] < X^' [xq, Vy^, </)(■)], and ellipticity of F, we are 
done. 

Assume u is a viscosity subsolution according to Definition 1. Let xq G S* and 
(p E C^(]R'^) such that u* — (p has a maximum in xq on Us{xo). (Wlog assume that 
M*(xo) = fixo), u* <ip on Us{xo).) 

Now consider the function 

ipix) := lffid\{7^.(x)u*(x) + lusix)(p{x), 

which is in VB. It is immediate that ip is upper semicontinuous if Us is closed, 
and in this case, we can construct a monotonously decreasing sequence (e.g., by ap- 
proximating with piecewise constant functions, smoothed by the standard moUifier) 
{ipk) cVBn C'^{R'') such that (pk i ip pointwise. 
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If Us is not closed, then ip need not be upper semicontinuous (if u*{y) < ip{y) for 
a ?/ G dUs n (UsY). In this case however, there is a small open neighourhood V of 
y where u* < ip (because ip G LSC, u* G USC). So we can approximate if from 
below in y n int{Us) with ipk > u*, and combine this in the construction as above. 

Let further (/j^ = (/p in B{xo,p) CC ^5(0:0) for some p > (possible by (l|2])). Then 
u*{xq) = ipkixo), u* < ifki and all local properties for ip^ in are inherited from ip. 
Applying Definition 1 yields 

F{xq,u* ,Vip,D'^ip,xY[xQ,ipk{-)] +Xy[xQ,Vip,ipk{-)]) < 

For each fc, by Proposition 15.11 (!iv|) . the supremum in F is attained in a Pk- Choose 
a subsequence such that Pk — )■ /3. Using the limit in ([33D, we obtain our result. 

Supersolution part, For analogously defined 99, here we have to show that 

F{xQ,u^,Wip,D'^ip,xY[xQ,ip{-)] +Xj''^[xo, Vv9,M*(-)]) > 

for which it is sufficient to prove F^{. . .) > for all P ^ B. We construct the sequence 
(ipk) with Lpk ip, 

ipix) := lKd\,7^(x)M*(x) + lusix)(p{x), 

as in the subsolution case (where the problematic part is M*(y) > 'p{y) in a ?/ G dUsn^UsY) ■ 
The result is obtained analogously (with (3 fixed) to the subsolution case using (134|) . □ 

Remark 5.3 The approximation from above of a use function by functions used in 
the second part of the proof of Proposition \5.4\ shows also that, in Definitions 1 and 2, we 
may restrict ourselves to functions ip G C^{W^) that are only C"^ in a small neighbourhood 
ofxo. 

We recall the semijets needed for a third equivalent definition. They are motivated by a 
classical property of differentiable functions. Let m : M'' M. 

J+u{x) = {{p,X) G M'^ X S*^ : u{x + z) < u{x) + {p,z) + ^{Xz,z) + o{\z\'^) as ^ -> 0} 

J-n(x) = {{p,X) G M'^ X S'^ : u{x + z) > u{x) + {p,z) + ^{Xz,z) + o{\z\^) as ^ -> 0} 

If u is twice differentiable at x, then J~^u{x) fl J^u{x) = {(Vu(x), D'^u{x))}. The limiting 
semijets are defined by, e.g., 

J^u{x) = {{p,X) G M*^ X S'' : there exist {xk,Pk,Xk) -> {x,p,X), 

{pk,Xk) G J^u{xk) such that u{xk) — )■ u{x)}. 

Definition 5.5 (Viscosity solution 3) A function u G VB is a (viscosity) subsolution 
of ( fl^) if for all xq G M'^ and (p G C^(M'^) such that u* — (p has a maximum in xq on 
Us{xo) and for (p, X) G J^u{xo) with p = Dip{xo) and X < D'^ip^xo), 

min ^F(xo,M*,p,X, J^'''[xo, (/?(■)] +2^^''^[3;o,P, M*(-)]),M* - A^M*j < in Xq e S 

min [u* — g,u* — 
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A function u G VB is a (viscosity) supersolution of [TB) if for allxo G and ip G C^(M'^) 
such that u^—if has a minimum in Xq on Ui^Xo) and for (g, Y) G J~u{xq) with q = Dip{xo) 
and Y > D^(f{xo), 

mm (^F{xo,u^,q,Y,Xy[xo,(p{-)] +Zf^[xo,q,u^{-)]),u^ - Mu^^ > in Xq e S 

mm (u* — g,u^ — Aiu^:) > in xq E {W^ \ S) 

A function u is a viscosity solution if it is sub- and supersolution. 

The conditions p = D(p{xo) and X < D'^(f{xo) etc. and the maximum condition seem to 
be superfluous at first view. However, they are needed to ensure consistency of (f with 
the "local" derivatives {p,X). 

Proposition 5.6 Definitions 2 and 3 are equivalent. 

Proof: One direction is obvious. The other direction (see jsl) uses as vital ingredient 
that we are considering the local maximum. □ 

5.3 A maximum principle 

Following jsl we give here a nonlocal theorem which should replace the "maximum prin- 
ciple" . Prior to this, we have to collect some properties of the intervention operator A4 
(compare also Lemma [4.3[1 : 

Lemma 5.7 (i) M is convex, i.e. for X G [0, 1], M{Xa + {l-X)b) < XMa+{l~X)Mb 

(a) For A > 0, M{—Xa + (1 + X)b) > —XMa + (1 + X)Mb (assuming the latter is not 
oo — ooj 

Proof: Follows easily from sup^{a{x) + b{x)) < sup^ a(x) + sup^6(x) and sup^{a{x) + 
b{x)) > sup 2; a{x) + inf^; b{x), respectively □ 

We need the following nonlocal Jensen-Ishii lemma that can be applied in the FIDE case 
(compare discussion below): 

Lemma 5.8 (Lemma 1 in jsj) Let u G USC{W^) and v G L5C(M'^), cp G ^2(^2^), 
// [xq, yo) G M2<^ is a, zero global maximum point of u{x) — v{y) — ip{x, y) and if p = 
Dx(p{xo,yo) , q = Dyip{xQ,yo) , then for any K > 0, there exists a{K) > such that, 
for any < a < a{K), we have: There exist sequences Xk Xq, yk yo, Pk P, 
qk — q, matrices Xk,Yk and a sequence of functions {(fk), converging to the function 
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iPa{x,y) := R°'[ip]{{x,y), {p,q)) uniformly in R^*^ and in C'^{B{{xo,yo), K)) , such that 

u{xk) u{xo),v{yk) -> v{yo) (36) 

{xk,yk) is a global maximum point of u — v ~ ipk (37) 

{pk,Xk) e J+u{xk) (38) 

iqk,Y,) e J-viyk) (39) 

IXk 







< D'ipk{xk,yk). (40) 



ifere pfc = VxVk{xk,yk), Qk = ^y^kixk^yk), and ipa{xo,yo) = (p{xo,yo), 'Vipa{xo,yo) = 
V(p{xo,yo). 

Remark 5.4 The expression ipnix,y) = R"'[ip]{{x,y), {p,q)) is the "modified sup- convolution'' 
as used by Barles and Imbert f^]- For all compacts C , tpo. converges uniformly to in 
C'^{C) as a — 0. This was already used in f^j, and can be seen by classical arguments 
using the implicit function theorem. 

We would obtain a variant of the local Jensen-Ishii lemma (also called maximum prin- 
ciple), if we weren't interested in the sequence [ipk) converging in - in this case the 
statement could be expressed in terms of the limiting semijets (or "closures") J , J 
(e.g., {p,X) G J^u{xq)). However, the local Jensen-Ishii lemma is only useful (in the 
PDE case), because it can be directly used to deduce, e.g., F{xo,u*{xo),p,X) < by 
continuity of F. Compare also the more detailed explanation in Jakobsen and Karlsen 
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This immediate consequence in the PDE case is a bit more tedious to show in our FIDE 
case (because the Levy measure u is possibly singular at 0), and needs the convergence 
of the {(fk)- The corollary for our impulse control purposes takes the following form: 

Corollary 5.9 Assume (\{^. Let u be a viscosity subsolution and v a viscosity 

supersolution of / I73|) . and ip G C^(M^'^). // (xo,|/o) ^ K^'' is a global maximum point of 
u*{x) — v^:{y) — ip{x, y), then, for any 5 > 0, there exists a such that for Q < a < a, there 
are {p,X) G J^u{xo) and {q,Y) G J f(yo) with 

min (^F{xo,u*{xo),p,X,ll'^[xo,Lpa{-,yo)] + Ty[xo,p,u* {■)]), u* - Mu*^ < 
min (^F{yo,V:,{yo),q,Y,iy[yo, -ipaixo, ■)] +l'^/[yo,q,v4-)]),v^ - Mv^^ > 

ifxo G S oryo G S, respectively. Herep = Vx^{xo,yo) = ^x^aixo^yo), q = -Vyip{xo,yo) = 
—'Vyfa{xo,yo), and furthermore, 



-i/< 

a 



X 
-Y 



< D^ipo,{xo, yo) = D^<p{xo, yo) + o„(l). (41) 



If none of xq, yo is in S, then we do not need this corollary, because the boundary 
conditions are not dependent on derivatives of functions ip. 
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Remark 5.5 Note that the fact {p,X) G J u{xo) (and the corresponding for the superso- 
lution) is not needed in the statement of the corollary, because the suhsolution (supersolu- 
tion ) inequality directly holds by the approximation procedure in the proof. An abstract way 
of formulating Lemma lSTB and Corollaru \5.9{ in the style of the local Jensen-Ishii Lemma 
(only subsolution without impulses) would be to define a new "limiting superjet" contain- 
ing the {p,X,ipa) obtained as limit of the terms in Lemma l5. 8[ Then Corollary \5.9\ could 
be stated as "For {p,X,(pa) in the limiting superjet, F{xo,u*{xo),p,X,ipai-),u*{-)) < 0" 
and would follow directly from Lemma \5.8\f provided some "continuity" 0/ F : M'^ x M x 
R'^ xS"^ X xVB hold. 

Proof of Corollary 15. 9t Because of translation invariance, we can assume wlog that 
u*{xo) — f*(yo) — v{^o,yo) = 0. Choose sequences according to Lemma [53] (applied for 
u* and f*), and K := max{dist{xo, Us{xq)), dist{yo, Us{yo))) + 1- Fix a G (0, a{K)). 

Subsolution case: If xq G S, then G S* for k large, and by Definition 3 and (l37|) - (l40l) . 



min (^F{xk,u*{xk),Pk,Xk,ll'^[xk,(pki-,yk)] + l'^/[xk,Pk,u* {■)]), u*{xk) - A^u*(xfc)j < 0. 

(42) 

First let us prove convergence of the PIDE part F . First, — )■ Xq, M*(xfc) — u*(xo), 
Pfc ^ p by Lemma [5.81 [X]^ is contained in a compact set in by fHUl) . so it admits 
a convergent subsequence to an X satisfying (l4Ti) . For each /c, by Proposition 15.11 (livl) . 
the supremum in F is attained in a /S^. Choose another (sub-) subsequence converging to 
/3 G 5. 

We now only need a reinforced version of (1551) in Proposition 15. II for X^'*^. By Lebesgue's 
Dominated Convergence Theorem, (M3]) and uniform convergence. 



lim / v9fc(xfc + ^(a;fc,/3fe,z)) - V5fc(xfc) - (Vv3fc(xfc),£(xfc,/3fe,0)) 1/(^2) 



ipJyXQ + ^(xo, /3, z)) - v9a(xo) - (Vv?q(xo), ^(xfc, /3, z)) u{dz), 

'\z\<5 

where the z/-integrable upper estimate can be derived by Taylor expansion and the esti- 
mates for k large 

sup \D'^(pk{z)\ < sup \D'^(pa{z)\ + K2 

\z — x\<Kl \z — x\<Kl 

for some Ki, K2 > (recall that \z\'^u{dz) < 00 for all compacts C, and that Us{yo) i 
for singular u). For TI'^ , we use Proposition 15.11 For the impulse part, we know by 



-/3 

Lemma 14.31 that Aiu* is use, so 

liminfM*(xfc) — Jliu*{xk) =u*{xo) — limsup A^'u*(xfc) > u*{xo) —A4u*{xo) 

k—^00 fc— >oo 

Now we have to combine the estimates derived so far. By iteratively taking subsequences 
and using (!33l) . we have the desired result for /c — )■ 00 in (H2|) . 

Supersolution case: If yo G S, then G S* for k large and by Definition 3 and (l37|) - fH0l) . 

min (F{yk,v^{yk),qk,Yk,ljj'^[yk,-(fkixk,-)] + ^y[yk,Pk,v*{-)]),v^{yk) - Mv^{yk)] > 0, 
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which means that two separate inequahties for the PIDE part and for the impulse part 
hold. The convergence of the PIDE part is proved in a completely analogous way, except 
that now fl34p in Proposition 15.11 is used in a reinforced version (again only needed for 
/3 G -B fixed). For the impulse part, we know that Aiv^ is Isc by Lemma [4.31 @, so 

limsupt;*(y/fc) - Mv^{yk) = v^{yo) - limini Mv^{yk) < v^{xo) - Mv^{yo) 

k^oo fc— 5>oo 

□ 



Remark 5.6 By inspecting the proof of Corollary \5.f^ we see that the statement also holds 
if u and v are suhsolution and supersolution, respectively, of different QVIs, provided of 
course that the conditions are satisfied. This will be used in the proof of the comparison 
Theorem \5.11i 



5.4 A comparison result 



Now we are prepared to give a comparison result (inspired by 29|): 



Lemma 5.10 Assume (^^, (MM)- Let u he a suhsolution and v a supersolution of / f73]) . 
further assume that there is a w & VB fl C'^{W^) and a positive function n -.W^ ^M. such 
that 

min(— s\vg{L^w + f^}, w — Aiw) > k in S 

l3eB 

min(u' — g,w — Aiw) > k inW^\S. 
Then Vm '■= (1 — + is a supersolution of 

min(— supji'^M + /^}, M — A^m) — /t/m = in S 

I3£B 

min(M — g,u — Aiu) — n/m = inW^\S, 



(43) 



and Um '■= (1 + — is a suhsolution of [T^) . and of ( [73] ) with —k replaced hy +k. 
Proof: We use the first viscosity solution definition. 

First consider the supersolution case. For ease of notation, we write v instead of t'*, and 
so on. Let ipm G PSnC^(M'^), xq & S such that (pm^xo) = Vmixo), (pm < Vm.. Choose ip = 
(<yi'm-^w)(^), then (p{xo) = v{xo) and ip <v. We know that - sup^g^{L^v5 + /^} > 0, 
and it is sufficient to show that L^Pm + < —n/m for all /3 G -B, in a point xq G S. 
Using the linearity of L, we obtain 

> h\vm - -w) + = lV + f- -iJ^'nj + /^) > L^^ + f + 

mm m m 
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Because of the convexity of Ai (Lemma 15.71 (ji])), in any point Xq G 



MVm. > "Wm — (1 —)MV —Mw > Vy, 

m m 

= — iw — Mw) > — 
m m 



[1 - —)v - —Mw 
m m 



It is easy to check that Vm — g > ^• 

For the subsolution u, the proof proceeds by a case distinction. The reasoning in the 
impulse part is the same, except that now the anticonvexity of M (Lemma 15.71 (jii])) is 
used. The PIDE part can be seen (for ipm{xo) = u„(xo), (pm. > Vm, '-P = {(pm + ^w){:^)) 
by 



< 



m 



sup[L'^^ + f] = sup[L^(^„ + / + -{L^w + f)] 

m p p m 



< snp[L^^m + f] + sup[-(L^w + f)] < sup[L^<^,„ + f] 

/s p m p 



K 



□ 



so we can conclude — sup^[L^<^m + /^] ^ 

We are going to use the perturbations of sub- and supersolutions to make sure that the 
maximum of Um — Vm is attained. So we want to find a > growing faster than \u\ and 
\v\ as |x| — 7- oo (how to find such a. w \s discussed in Section El the requirements lead to 
the function F being proper in the sense of Crandall et al. 181]). 



If cr(-,/3), ^{-,(3), f{-,l3), c are Lipschitz continuous, then by classical results (see, e.g.. 
Lemma V.7.1 in Fleming and Soner 2^), our function F has the property: 

For any R > 0, there exists a modulus of continuity ur, such that, for any 
\y\, \v\ < R, I & W and for any X, F G S**^ satisfying 



X 






-Y 



1 

< - 

e 



I -I 
-I I 



Oa{l) 



for some e > (oq,(1) does not depend on e), then 

^(y, V, e-^{x-y), Y, /)-F(x, v, e~^{x-y),X, I) < ujR{\x-y\+e~^\x-y\'^)+Oail), 

where 0^(1) again does not depend on e, and the first term is independent of a. In the 
proof of of Theorem 15.11^ x^, y^ converge to the same limit Xq, so the requirement can be 
relaxed to locally Lipschitz (as required in Assumption 12. 4p and the property holds only 
for x,y in a suitable neighbourhood of xq. 

Recall that VBp is the space of functions in VB at most polynomially growing with 
exponent p. Assuming essentially that there is a strict supersolution of ( 1T3|) . the following 
theorem holds: 



Theorem 5.11 Let Assumptions \2. 1\ \2.3\ and 2.4 be satisfied and c be locally Lipschitz 
continuous. Assume further that there is aw > as in Lemma \5.1II (for a constant n > 0) 

I is a subsolution and v G VB„(M.'^) a 



with \w{x)\/\x\^ — 7- oo for \x\ — oo. If u E VBp{ 
supersolution of /I75|). then u* < v^,. 
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Corollary 5.12 (Viscosity solution: Uniqueness) Under the same assumptions, there 
is at most one viscosity solution of l[T^) . and it is continuous. 



The now following proof of Theorem 15.111 uses the strict sub-/supersolution technique 



(adapted from Ishii [29[). We first prove that a maximum can not be attained outside 
S (because then this would have been because of an impulse back to S). Then we use 
the classical doubling of variables technique, apply the non-local maximum principle, and 
by a case distinction reduce the problem to a PIDE without impulse part (then adapting 
techniques of Barles and Imbert jsj). 

Proof of Theorem 15.111 Write u instead of u* and v instead of t'* to make the 
notation more convenient. It is sufficient to prove that Um — Vm < for all m large (where 
VL'Tji 5 cire as defined in Lemma [5.101) . Let m G N be fixed for the moment. To prove by 
contradiction, let us assume that M := sup^.g]jjd Um{x) — Vm{x) > 0. 

Step 1. We want to show that the supremum can not be approximated from within 
M.'^ \ S. Assume that for each ei > 0, we can find an x = G M"' \ S* such that 
Um{x) — Vm{x) + El > M (and wlog Um{x) — Vm{x) > 0). By the sub- and supersolution 
definition, we have 

mm{um{x) - g{x), n„,(x) - Mum{x)) < 
mm{vm{x) - g{x),Vm{x) - Mvmix)) > n/m 

If Um{x) — g{x) < 0, then n/m + Um{x) — Vm{x) < Umix) — g{x) < which is already 
a contradiction. If Umix) < J^Um{x), then select for 52 > a = Cei,e2 such that 
u^{r{x, 0) + K{x, + £2 > Mu^{x). Then, 

M -ei< Umix) - Vmix) < Um{T{x, Q) + K{x, C) + £2- n/ni- K{x, C) - VmiT{x, 0) 

< £2 - n/m + M, 

which is a contradiction for 61,62 sufficiently small. This shows that the supremum M 
can not be attained in M'^ \ S, neither can it be approached from within M.'^ \ S. 

Step 2. Now that we are sure we do not have to take into account the boundary 
conditions, we employ the doubling of variables device as usual. We define for e > and 
Um,Vm chosen as in Lemma 15. 101 

Me= sup ( Um{x) - Vm{y) - ^\X - 



In view of the definition of w and UmiVm, the maximum is attained in a compact set C 
(independent of small e). Choose a point {xs,ye) ^ C where the maximum is attained. 
By applying Lemma 3.1 in [l8|, we obtain that -^Ix^ — — )■ as 5 — )■ 0, and that 
Me — )■ M = Um{xo) — Vmixo) foT all limit points Xq of (x^). We assume from now on wlog 
that we have chosen a convergent subsequence of (x^), (ye), converging to the same limit 
Xq G C. Let e small enough such that x^, ye ^ S (by Step 1), and that all local estimates 
in (EdD, (BE]) hold. 
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Hence, we can apply Corollary 15.91 in (Xe,?/^) for (p{x,y) = j^\x — yp: For any 6 > 0, 
there is a range of a > 0, for which there are matrices X, Y satisfying fl4ip . and {p, —q) = 

Vip{xe, Ve) (so p = g = - i/e)) such that 

mm(^F{Xe,Um{Xe),P,X,Z^^'^[Xe,fa{-,ye)] + [Xe, P, Um{-)]) , Um{Xe) - MUm{Xe)^ < 

min (^F{y^,v^{ye),q,Y,ll'^[y^, -ipa{xe, ■)] +^'^/[ye,q,Vm{-)]),Vm{ye) -Mv^{y^)^ > 

Case 2a {um{xe) - Mum{xe) < 0): Using v„i{ye) - Mvm{ye) > ^, for e > small 
enough, 

M = limsup(u„,(a:£) - Vm{ys)) 

< limsup A^n„(a;£) - Mmini Mv„,{ys) < Mum{xo) - Mv„^{xo) , 

e^O e^o m m 

where we have used the upper and lower semi continuity of Aiu^ and Aivm, respectively 
(Lemma \5.7\i . The contradiction is obtained as in Step 1. 

Case 2b (umixs) — Aiumix^:) > 0): It remains to treat the PIDE part 

F{Xe,Um{Xe),p,X,ll'^[Xe,(Pai-,ye)]+l'^/[Xe,P,Um{-)]) < (44) 

F{ys,Vm{ye),q,Y,ll'^[y,,-iPa{xer)]+lV[ye,q,v^{-)]) > —■ (45) 

^ ^ m 

Before we can proceed, we have to compare the integral terms in both inequalities. First 
note that because \x + i{x, /3, z) — = |x — + 2(x — y, £(x, /3, z)) + |£(x, /3, z)p, for all 

J\z\<5 



1 



V [ye,-^{Xe,-)\ = TT / -\^{ye^l^.z)\ u{dz) < CX), 

J\z\<S 

(finite by (Mil) definition of VB) so trivially X^'''[xe, </?(-, y^)] < I^'^ly^, —Lp{xs, ■)] + 
^0^(1). Because we know that (fa converges to (f uniformly in C^(C) for any com- 
pact C, we can see analogously to the proof of Corollary 15.91 that X^'^[xs,(Pai-,ye)] < 
I^'^lys, —ipa{xs, ■)] + ^^^(l) + Oa(l), whcrc Oo(l) may depend on e, but is independent of 
small 6. 

Using that (x^, y^) is a maximum point and again \x + = |xp + 2(x, + 

Mm(x£ + (i)-M„,(x£)--(Xe-?/e,(i) < Vm{ye + d') - Vm{ye) -- {Xs -ye, d') + - d'\^ (46) 

where d, d' are arbitrary vectors. We find by integrating (H^ for all /3 and d = i{x^, (3, z), 
d' = £{y,,l3,z) that 

I^lxs, p,Um{-)] <l'^/[ye,q,v„^{-)] + TT / \^i^e,l3,z) - i{ye,f3,z)\^u{dz) 

J\z\>5 

+ / {p,l{xe,P,z)-l{y,,P,z))v{dz). 

J\z\>l 
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We then have by (B[T]) for e > small enough, (denoting = X^' [x^, ip{-, ?/£)]+X^' [x^, p, Um{-)] 
and = ll'^ive, -^{xs, ■)] + ^i^iVe, g, ^^m(-)]) that 

/J < + 0{^\xs - ye\^) + ^0^(1) + o„(l) 

where 0(^|xe — Vel"^), os{l) and Oq(1) are independent of (3 because of (HID- Likewise, 
0(-|xe — is independent of 6 and a. Thus 



- < F{y„vUye),q,Y,ll) - F{xs,Umixe),P,X,ll) by dH and (gS]) 

< F{ye,Vm{ye),q,y,ll) - F{xe,Vra{ye),P,X,ll) for Small £ bccause c > 



< F{ys,v^{y^),q,YJl) - F{x^,Vm{ye),P, Xjjj) + 0{-\xe - ye 



-os{l) + Oail] 



where we have used ellipticity (HI]) and Lipschitz continuity (F|3]) in the last component 
for the O and o values independent of /3. The matrix inequality fHT]) becomes 



X 
-F 



1 

< - 

e 



I -I 
-I I 



Oa(l). 



(47) 



By assumption (E(2]) for i? > large enough {vm is locally bounded) and e small enough. 



— < UJrHXs -ye\+£ ^\Xe " ^/e H + 0{-\Xe - + - 

m e e 



05 1 +0, 1 



Now let subsequently converge 5 — )■ (because of the special dependence of a - the smaller 
S, the larger a - this does not affect a), and then a 0@. The contradiction is finally 
obtained by e — 0. □ 



5.5 Parabolic case 

Now let us deduce the parabolic result from the preceding discussion. We will keep the 
presentation short, only outlining the differences to the elliptic case. We recall the form 
of the parabolic QVI (where d~^ST denotes the parabolic nonlocal boundary): 

min(— sup{nt + L'^n + /^}, u — M.u) = in S't 

/3GB dH]) 

min(M — g,u — A4u) = in d^Sr, 

where for y = {t,x) 

L^uiy) = ^tr{a{y,f3)a''{y,(3)DMy)) + {^y, f3),Vu{y)) 

+ j u{t, X + i{y, (3, z)) - u{y) - {Vu{y),l{y, /3, 2;))l|.|<i v{dz). Q 

^By a — > 0, we lose the first part of the inequahty (|T7)) (so we can not be sure anymore that X . Y are 
bounded because they are dependent on a) 
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The function F then is 

F{x, r,p, X, (/^)) = - sup I l-tr (a(x, /3)a^{x, /3)X) + p) + f{x, /3) + lA , 

and the QVI (with the obvious adjustments, compare also section 14. ip then is 

min(-nt(y) + F{y,u{y),W ^u{y),Dlu{y),Xp[y,u{t, ■)]),u{y) - Mu{y)) = 0. 

All assumptions and the definition of the space VB = VB{[0,T) x M'^) are as introduced 
in section [21 The test functions (p are now in C^'^([0,T) x M'^) (once continuously differ- 
entiable in time). Instead of Us{tQ,xo) C M'^, we consider [0, T) x Us{tQ,xo), where the 
[0, T) could in principle be any time interval open in [0,T) containing to- 
Recall the definition of a viscosity solution of ([8]) from section HTTl The original motivation 
for introducing the different definitions of viscosity solutions was to cater for the singular- 
ity in the integral. Because this integral, started in (to, Xq), only takes into account values 
at the time to, the different definitions in section \^?2\ are equivalent in the parabolic case, 
too (where the time derivative in t = is only the one-sided derivative). 

For the third definition (Definition 15. 5p . we need the parabolic semijets P~^u{t,x) and 
P~u{t,x) on [0,T) X R'^, e.g., 

P~^u{t,x) = {(a,p,X) e R X R"^ X S'^ : u{t + s, X + z) < u{t,x) + as+ {p, z) 

I 

+ -(X^,^) + o(|s| + as s,z^ 0, {t + s,z) G [0,T) x R'^}. 

The reformulation of Definition [331 is then ^^For {a,p, X) G P^u{to,Xo) withp = D^ipitQ^Xo) 
and X < D'^ip{tQ, Xq), . . . ", and in the same way for the supersolution part (we have re- 
quirements only on p and X because only they need to be consistent with ip as used in 
the P'^ integral). 

Finally, we obtain the parabolic maximum principle for impulse control: 

Corollary 5.13 Assume (mD, (ME)- Let u he a viscosity suhsolution and v a viscosity 
supersolution of and ip G C^([0, T) x M^*^). // (to, Xq, yo) G M^'^"^-'^ is a global maximum 
point of u*(t,x) — v^,{t,y) — ip{t,x,y) on [0, T) x M*^, then, for any 5 > 0, there exists a 
such that for Q <a <a, there are {a,p,X) G P^n(to,Xo) and {b,q,Y) G P v{to,yo) with 

min (^-a + F{xo,u*{xo),p,X,Xjj'^[xo,<Pa{-,yo)] + ^f^[xo,P, u* {■)]), u* - Mu*^ < 
min (^-b + F{yo,v^{yo),q,Y,Zl'^[yo, -iPaixo, ■)] + iy[yo,q,v^{-)]),v^ - Mv^^ > 

if Xq e S or yQ G S, respectively. Here a + b = ipt{to,xo,yo), P = '^x'-p(to,xo,yo) = 
Vx'Pa(to,Xo,yo), q = -Vy(p(to,Xo,yo) = -Vy(pa{to,Xo,yo), and furthermore, 

< Df^,y)^a{to, Xo, yo) = L*^^. j^)(^(to, Xq, yo) + o„(l). (48) 



- -/ < 

a 



X 




-Y 
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The proof is in no way different, once the parabohc Jensen-Ishii lemma (proved by the 
same technique as Lemma l5.8p is available. The requirement a + h = ift(tQ,XQ,yQ) is 
immediately plausible from the necessary first order criterion in time. Compare also 



Barles and Imbert ISlI, Crandall et al. 18 



Finally, a comparison theorem can be formulated. Lemma fS.lOl is still true in the parabolic 
case, due to the linearity of the differential operator. 

Define VBp = VBp{[0,T] x M'^) in the parabolic case by all functions u e VB, for which 
there is a (time-independent!) constant C such that |u(t, x)| < C(l + \x\^) for all {t,x) G 
[0, T] X M'^. The upper (lower) semicontinuous envelope u* (v^^) is again taken from within 
[0,T] X M"'. 

Theorem 5.14 Let Assumptions }^. 1\ \2.'^ and \2.4\ he satisfied. Assume further that there 
is aw >Q as in Lemma \5.1(A (for a constant k, > 0) with \w{t,x)\/\x\^ — >■ oo for \x\ — )■ oo 
(uniformly in t). If u e VBp{[0,T] x M*^) zs a suhsolution and v G VBp{\Q,T] x M^) a 
supersolution of then u* < on [0,T] x W^. 

Corollary 5.15 Under the same assumptions, there is at most one viscosity solution of 
and it is continuous on [0,T] x M*^. 

Proof of Theorem I5.14t We only point out the differences to the elliptic Theorem 
15.111 Define M := supjgjo.Ti.xGiR'' ^) ~'^m(t,x) and assume it is > 0. Step 1 is proved 
as in the elliptic case, but on the parabolic boundary d~^ST- For Step 2, we again know 
that the supremum 

Me= sup (um{t,x) -Vm{t,y) - ^\x -y\^ 

te[0,T],x,y€R'i \ 

is attained in a compact set of [0, T] x M'^ x R'^ (independent of small e), say in (te, x^, ye)- 
For small enough e, we know by Step 1 that t^ < T and Xe,ye £ S. We proceed as in 
the elliptic case, and arrive at the PIDE case 2b. All integral estimates hold because t^ is 
fixed at the moment, and the conclusion is exactly the same (the time derivatives a and 
b cancel out when subtracting the PIDE sub-/supersolution inequalities). The modulus 
of continuity needs to exist locally uniformly in tg before letting e converge to 0. □ 



6 Conclusion 

We have shown in the present paper existence and uniqueness of viscosity solutions for 
impulse control QVI. The results we have obtained are quite general, and the (mini- 
mal) assumptions required (basically (local Lipschitz) continuity, continuity of the value 
function at the boundary, and compactness and "continuity" of the transaction set) are 
sufficient to guarantee a continuous solution on M'^. We note that the Lipschitz continu- 
ity assumptions are already needed to ensure existence and uniqueness of the underlying 
SDE. 

The complications to be overcome were mainly 
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• The discontinuous stochastic process and definition of the value function on M 

• The possibly singular integral term in the PIDE (arisen from the Levy jumps) 

• The additional stochastic control 

It is our hope that the parabolic and elliptic results presented can be used to great benefit 
in applications of impulse control without the need to go into details of viscosity solutions 
(as typically the value function in - at least financial - applications will be continuous). 
The comparison result can also be used to carry out a basic stability analysis for numerical 
calculations. 

Admittedly, our results do not cover all special cases - but quite frequently, one should 
be able to extend the results of this paper easily. E.g., state constraints can be handled 
with a modified framework, where the continuity inside 5* in general should still hold (see 
also Ly Vath et al. |35[). This leaves some room for future research. 

Acknowledgements. The author wishes to express his thanks to Riidiger Prey and H. 
Mete Soner for valuable comments. 



7 Appendix 

Lemma 7.1 Consider a process X^"'*"'^" following the SDE started at {tn,Xn), and 
controlled with a stochastic control f3"'. Denote the first exit time for p > by := mf{t > 
tn '■ |A'f — Xn\ > p}- Suppose that all conditions for existence and uniqueness are 
satisfied for X'^" , that (I^ holds and that (tn,Xn) (tQ,xo). Then for all 6 > there is 
a i > such that 

limsup P(|r^-to| < i) < 5. 

n—^oo 

Proof: We want to prove that there is no subsequence in n such that P(|r^— 1„| > e) — 
(n — )■ oo) for all e > 0. Define 

Kn,e := nK -tn\>e)=n SUp |Xf - Xn\ < p) ■ 

<S<tn+£ 

By stochastic continuity, we have for each fixed n that Kn^e — > 1 for e — > 0. This 
convergence is uniform in n for the following reasons: By (EH]), we can find a constant /3 
such that X'^'*"'^" has a higher "variability" than 

P( sup |xf - a;„| < p) < P( sup |xf"'*"'^" - x„| < p) 

tn<S<tn+e tn<S<t„+e 

for all e small enough and n large enough. Purther, for n large enough such that Xo| < 
p/3, 

P( sup |Xf'*"'^" < p) 

tn<S<tn+e 

> P( sup |xf'*"'^" - xf'*0'^o| < p/3 A sup |A:f'*0'^« - xol < p/3) 

tn<s<t„+e to<s<io+e 
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Finally, by stochastic continuity [in the initial condition] (cf. Gikhman and Skorokhod 



27(1, p. 279), the right hand side converges to 1 for e — (uniformly in n for n large 
enough). This means that for any subsequence {Kn^^s)k converging in k for all e > 0, 
there is an e such that the limit must lie arbitrarily close to 1. □ 

Lemma 7.2 Let {X^)t>Q he a sequence of random variables, and let Xt converge to Xq = 
X e M*^ m probability for 1 10. Then: 

(i) For all e > 0, and for all sequences tn — )■ 0, 

P( sup - x| > e) 0, oo 

Q<S<tn 

(a) 11) holds true also for a sequence of positive random variables {Tn) converging to 
in probability (not necessarily independent of X). 



(Hi) lil) holds true also in the setting and under the assumptions of Lemma 7.1 



I.e., 



P( sup |Xf"'*"'^" - x„| > e) ^ 

for {tn,Xn) — {to,xo), random variables Tn > tn, Tn — J- to in probability. 

Proof: @: By assumption, for all e,S > there is a set f/ = [0, u] for n > such that 
for all s E U, f{\Xs — x\ > e) < 5. Fix now e,5 > 0. Dependent on w, 7 > and t > 0, 
choose t{u,j,t) G [0,t] such that jX^^^^^^j) — x\ > supo<5<( \^t{<^) ~ ^\ ~ 1- 
Select now 7 := e/2. Then, 

P( sup |X, -x\>e)< n\Xiiu.,,,t) -x\> ^^/2) 

0<s<t 

Let U = [0, u] be such that — x\ > e/2) < 6 for all s E U. Now choose t := u, so 

t{ijj, 7, t) G [0, u], and thus P(supo<s<j \Xs — x\ > e) < 6. 

dn]): Set for a fixed e > At := {u : supo<s<t \Xs — x| > e}. We know that P(A) — )■ for 
t — > 0, or, equivalently, l^t — > a.s. Now let t > be fixed, and (Tn) be a sequence of 
random variables converging to in probability. Then, a.s., 

lAt = Uil{t<T„} + Uil{t>r„} > Uil{t<r„} + lA,„l{t>r„} 

because 1^^ < Ia* for s <t. The convergence n — )■ 00 shows that > liKisup„_^oo lAr„- 
For t — )■ we get: 

> limsupl^^^ > 0, 

thus Ia — !■ a.s. for n — )• 00. 

f lmj) : Consider A" := {w : supj^<<,<^ |jf^n,tn,a;n _ ^j^J > 5^ j in the proof of ([n]). Then it can 
be checked in the proof that also P(y4"^) — 1 for — )■ 00, because by the proof of Lemma 
I7.H P(A") — )■ 1 for t — )■ to, ^ > tn, uniformly in n large. 

□ 
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